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ABSTRACT 

This manual describes a training program for teacher 
evaluation. The purpose of the program is to provide educators who 
evaluate classroom instruction with the tools that result in 
professional growth for the teachers and improvement of classroom 
instruction. Joint participacion by teachers and administrators is 
encouraged in all phases of the evaluation process. The training 
program has five modules. The first module reviews the research on 
teacher evaluation, addresses the concept of common vision, presents 
a model of a growth-oriented evaluation system, and provides training 
in conducting a planning conference. The second module informs 
participants of the kinds of classroom behavior that can be recorded 
through observation, familiarizes them with the use of common 
observation tools, and demonstrates the utility of teacher-made 
observation tools. The third module presents methods for analyzing 
and interpreting descriptive data and provides procedures for a 
mutually productive postconference leading to meaningful goal 
seating. The fourth module presents means of measuring instructional 
effectiveness: student assessment, teaching artifacts, student 
evaluations, and self-assessment. The fifth module includes criteria 
for productive goals, an<? ideas for motivating teachers and providing 
resources. The modules follow a sequential procedure and include all 
back-up materials. The format for each module is: module overview, 
training agenda, activity instruction sheets, participant handouts, 
and hard-copy transparencies. A separate "Teacher Educati'^n Profile 
(TEP) User's Guicf.e," dated December 1989, with related and 
non-duplicative content, has been appended. (JD) 
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TEACHER EVALUATION FOR GROWTH 



PREFACE 



For several years, the Northwest Regional Educational Laboratory (NWREL) 
has conducted research in growth-oriented teacher evaluation. This 
research, based on effective schools practices and NWREL's work in 
schools, identified the important attributes of a specific kind of 
teacher evaluation envi ronment— that is. an environment that p.omotes the 
professional development of teachers. 

NWREL's research has been translated into a program to assist school 
districts in developing an effective teacher evaluation program 
Acknowledging that school systems are unique in their needs for effective 
evaluation practices, program components and levels of service are 
adapted to meet specific needs, goals, and objectives of the various 
districts. The training process described in this manual is only one 
phase of a multi-strand system described below that also includes an 
awareness workshop, an evaluation of the district teacher evaluation 
environment, and technical assistance in evaluation planning. 



Awareness Workshop 

The Awareness Works.iop brings participants up-to-date on recent research 
in teacher evaluation. Also presented is the methodology of evaluating a 
school district's evaluation program through the administration of the 
Teacher Evaluation Profile (TEP). 



District Evaluation and Design Conferen ce 

The Design Conference provides the district an assessment of their 
current evaluation program and precise diagnostic information on the 
potential growth and professional development of the district teacmng 
staff. This assessment is based on a survey in which teachers are asked 
to respond to items on the Teacher Evaluation Profile, a questionnaire 
describing a teacher's most recent evaluation experience. 



Technical Assistance 

Technical Assistance is available to educational agencies in the process 
of reviewing, evaluating, or revising the teacher evaluation program. 
The agenda !S flexible to accommodate unique needs, interests, and 
concerns. 



Training 

If results of the TEP analysis, review of district evaluation procedures, 
and discussion during the design conference reveal specific teacher 
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evaluation skills that need to be developed in the district, NWREL has 
developed a series of workshops that can be adapted to meet those 
training needs. It is recommended that training include teams of 
administrators and teachers. 

Though the main thrust of the training is to assist in setting up an 
evaluation program for competent teachers whose goals are to continue to 
grow professionally, the activities and materials may be adapted to 
support the accountability or summative program of evaluation. 

This training manual is the culmination of research and work in the 
schools. We have been privileged to assist school districts m 
developing their teacher evaluation programs and involving thei-- teachers 
and administrators in the piloting of the training components in this 
manua I . 

Of special note is the partnership program developed with the Centennial 
School District, Portland, Oregon. Centennial was one of five districts 
piloting the Teacher Evaluation Profile (TEP). This program expanded to 
include both a coMegial training program for teachers and administrators 
in effective evaluation procedures and a collaborative effort in 
developing an evaluation program with a major emphasis on how to promote 
teacher growth whiie demonstrating minimum competency required by law. 
The opportunity of working with this c^istrict in a supportive environment 
resulted in a program that has become a model for other school districts. 

We wish to express sincere appreciation to those whose knowledge and 
support have provided the encouragement and supported the concept of 
developing a program based on evaluation for professional growth and 
development. Special thanks to Daniel Duke, Keith A. Acheson, Ted 
Andrews, Marv Hempel , and regional laboratory researchers for their 
support and contributions to our efforts. And finally, thanks to Carrol 
Neuhart and Merry Mi Mage for their patience and careful preparation of 
this manual . 



Mary T Rose 
Richard St iggins 
Fran Caldwel I 




FIVE KEYS TO GROWTH 



TEACHER EVALUATION FOR PROFESSIONAL DEVELOPMENT 



INTRODUCTION 



This manual describes a training prograni for those who are involved in 
teacher evaluation. The purpose of the program is to provide educators 
v»ho evaluate classroom instruction with the necessary tools that rt-ult 
in professional growth activities for the teacher and imoroved classroom 
instruction. The purpose of this manual js to prepare trainers to 
present the program to educators on the firing line. 

This program is based on research conducted by the Northwest Regional 
Educational Laboratory (NWREL). That research involved a review of the 
effective schools literature and extensive interviewing and surveying of 
school district teachers and administrators involved in teacher 
evaluation. A detailed account of the research is described in two 
recently published books: The Case for Commitment to Teacher Growth: 
Research on Teacher Evaluation (State University of New York Press) and 
Teacher Evaluation: Five Keys to Growth (co-published by the American 
Association of Scnool Administrators, National Association of Secondary 
School Principals, National Association of Elementary School Principals, 
and the National Education Association). Both are co-authored by Richard 
J. Stiggins and Daniel L. Duke. Prospective trainers are urged to obtain 
copies of each of these and study them as part of their preparation. 

Duke and Stiggins" studies identified five valuable keys or elements to 
an effective growth producing evaluation process. There are elements 
that teachers bring to the evaluation event that contribute to the 
positive results of the experisnce. There are attributes that the 
evaluator brings to the event that contribute to success. The specific 
procedures used to collect performance data also are related to a 
positive outcome of the evaluation, as are specific characteristics of 
the feedback delivered to the teacher. And finally, the general context 
within which the event takes place appears critical to its success. The 
research revealed that when these elements are integral to the evaluation 
process there is great potential for teacher growth and professional 
development. Thus, attributes of these elements promoting the 
professional growth of teachers form the basis for this training. 

Joint participation by teachers and administrators is encouraged in all 
phases of the evaluation process and therefore of this training. A 
primary purpose of the training is to build a strong, collegial 
relationship between teachers and supervisors. A ^oal of the training is 
to develop, through teams of teachers and administrators, the cooperative 
effort necessary to achieve the mutual trust needed to promote teacher 
growth and school improvement. 



Tne training program has five modules based on the elements described m 
Teacher Evaluation: Five Keys to Growth . To develop a comprehensive 
program, the full training schedule of five modules is recommended. 
However, modules may be used alone or with any number of the others based 
on a district's need or interest. The TEP is often used m a district to 
identify specific modules that would be most beneficial to a specific 
evaluat ion program. 



CONTENT OF THE FIVE MODULES 

Module 1 - Setting the Stage: Teacher Evaluation for Professional Growth 

When teachers and administrators conmunicate openly, important things can 
happen Concerns and goals can be shared and eventually agreement 
reached. This is known as "coming to a common vision," and is the first 
step in a teacher evaluation program for growth. This module reviews the 
research which produced the publication Teacher Evaluation: Five Keys to 
Growth and the Teacher Evaluation Profile (TEP), a questionnaire 
describing teachers' perceptions of the evaluation environment. The 
moaule also addresses the concept of common vision, presents a model of a 
growth oriented evaluation system, and provides training m the 
conducting of a planning conference. 

Module II - Collecting Observation Data 

When teachers are given specific, accurate, descriptive data on classroom 
instruction, particularly when the focus is on aspects the teacher 
selects there is motivation to change, take risks, and improve classroom 
instruction. Therefore, to facilitate a teacher's professional growth, 
classroom observation must be teacher directed, specific, and accurate. 
Module II informs participants of the kinds of classroom behavior that 
can be recorded through observation, familiarizes them with the use of a 
number of common observational tools, and demonstrates the utility of 
teacher-made observation tools. 

Module III - Providing Feedback/The Post Conference 

Having collected classroom data the next step for observer and teacher 
IS to analyze and interpret the results The task is the teacher's All 
data should be received by the teacher first. Because the information 
was recorded purely as descriptive rather than judgmental data, the data 
usually speaks for itself. Listening, sharing, and asking for 
suggestions in a caring environment are valuable components of the 
post-conference. This module will present methods to analyze and 
interpret descriptive data and provide procedures for a mutually 
productive post -conference leading to meaningful goal setting. 

Module IV - Using Other Sources of Data 

Though classroom observation is often used in teacher evaluation, other 
sources of evaluation data are not to be discounted, particularly in 
evaluation for professional growth where legal and contractual 
requirements are not restrictive. This module presents other means of 
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measuring instructional effectiveness: student assessment, teaching 
artifacts, student evaluations, and self-assessment. Through a 
combination of data gained using these metnods and classroom observation, 
a more def ini t ive i-ricture of instructional skill comes together. 

Module V - Goal Setting and Next Steps 

integral to effective evaluation is the goal setting process. Goal 
setting occurs when reliable data have been collected, analyzed, and 
interpreted. Only then can meaningful, achievable goals be set. This 
module gives participants criteria for productive goals and presents 
ideas for motivating and providing resources for teachers. It also 
allows participants to begin the process of implementing a growth 
oriented evaluation program in their own school. Participants are 
encouraged to break with tradition ana begin to think creatively in 
regard to their particular school or district and its needs. 



TIME CONSIDERATIONS 

If all five modules are to be covered, it is best to allow three weeks to 
one month between each to give participants time to complete the activity 
assignments associated with each module. These activities are assigned 
at the conclusion of Modules i , 1 1 , I If , and I V. If fewer than five 
modules are proposed, trainers will need to adjust the assignments 
according to the modules selected for training. 

Approximately three hours should be scheduled for each training session. 
This will allow sufficient time for presentations, lecturettes, etc. and 
provide the trainer with the flexibility needed to provide adequate time 
for participant interaction. There are suggested timelines in the 
directions for the activity m each module. The times are for groups of 
no more than 30 participants. 

MODULE FORMAT 

Modules present a step by step procedure and include all back-up 
materials. The format for each module is as follows: 

Module Overview providing definition, anticipated outcomes, and 
agenda. 

Training Agenda providing the procedure of the module with time 
allowances and required materials. 

Activity Instruction Sheets giving detailed trainer instructions 
for each activity on the agenda. 

Participant Handouts with accompanying Activity Instruction 
Sheet. Each is labeled with an identifying code, e.g., H 
(hand-out)- 1 (module number )-2 (handout number). 
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Hard*copy Transparencies given in order and annotated on the 
Activity Instruction Sheet. Each is labeled with an identifying 
code, e.g.. T (transparency)-! I (module number)-4 (transparency 
number). 

Space is allocated at the end of each activity in the manual for 
trainer's notes regarding any modifications of activities that will 
compliment a trainer's style of presentation. 

Materials in the training manual are color coded. The trainer 
instructions are grey; transparencies are white, and participant handouts 
are blue. Separate packages of hard copy transparencies and participant 
handouts accompany the trainer's manual. 



ADDITIONAL TRAINING SUPPLIES 

Equ i pmen t : 

Overhead projector 
Video cassette recorder 
Television monitor 



Materials : 

Name tags 
Chartpack 
Masking tape 
Push pins 
Marking pens 
Chalk 

Pens, penci Is 

Blank paper 

Blank transparencies 

Two viJeotapes of teaching episodes 

Transparency pens 
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Note on videotapes : 

Videotapes of teaching episodes provide workshop participants with an 
opportunity to practice taking classroom performance data. "Another Set 
of Eyes: Techniques for CI assroom Observat ion" . a training series 
produced by the Association for Supervision and Curriculum Development, 
includes videotapes appropriate for the data gathering activities in 
Module II. 

If possible, it is recommended that trainers make their own tapes. 
Seif -confident teachers are usually willing to allow a video camera in 
their classroo.T.d, particulaMy if the tape is to be used in other schools 
or districts. Give teachers sufficient advance notice of tne time and 
date of the taping. Stress that tht class session should be unrehearsed 
and as close to a "normal" class period as possible. 

If the trainer will be doing the videotaping, the following suggestions 
prove helpful in producing a more professional product. A video cassette 
tape, television camera, compatible video cassette recorder, television 
monitor, and a tripod are essential when producing a videotape. 
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Position the camera, mounted on the tripod, somewhere near the middle at 
the side of the room where the faces of the teacher and students can be 
viewed without a great deal of camera movement; and the voices of all, 
particularly the teacher, can be easily recorded. Long shots, which 
capture the background, and medium shots, retaining most of the 
background, are probably most useful. Close-ups will exclude too much. 
Keep tne process simple, as any attempt at "creative*' zooming and panning 
may result in a blurry presentation. As in all earner*^ work, be careful 
of lighting. Keep your back to bright windows so thr,t light is on your 
subjects, not behind them. 

Begin when the class or lesson does. Starting in the middle may be 
confusing to the viewer and disruptive to the class and teacher. Twenty 
or thirty minutes is generally long enough for a practice observation 
tape. 



OTHER ITEMS TO CONSIDER 
Before conducting training- 

1. Verify daie, time, place, and number of participants expected. 

2. Try to hold sessions in a room with movable seating to accommodate 
both large and small group settings. Tables with five or six chairs 
are ideal . 

3. Prepare sufficient handouts and arrange in order of use. 

4. Prepare and organize transparencies, and position an overhead 
projector so all observers have an unobstructed view. 

5. Check all equipment and material needs. Make sure machines are in 
working condition and locate outlets and light switches. 

During the training: 

1. Encourage participants to groco themselves by school or district. 

2. Move activities along, better a little too fast than too slow. 

3. Allow for breaks approximately half-way through each session. Ten 
minutes is usually sufiicient. Refreshments are appreciated. 

4. Do not read or memorize a lecturette. Speak from notes or from the 
transparencies. 

5. Watch participants for signs of boredom or confusion. Ask for 
clarification questions regularly. Modulate voice and use eye 
contact to involve listeners. 

6. Take a positive approach, show enthusiasm, and enjoy yourself. 
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NODULE I. SEHING THE STAGE 
TEACHER EVALUATION FOR PROFESSIONAL GROWTH 



"TEACHER PERFORMANCE EVALUATION, HERETOFORE, 
HAS BEEN A SOLO VENTURE AKIN TO TAKING A BATH 
- YOU NEVER GET TO WATCH ANYONE ELSE DO IT." 

RICHARD P. MANATT, IC^A STATE UNIVERSITY/AMES 
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NODULE I - OVERVIEW 
SETTING THE STAGE 
TEACHER EVALUATION FOR PROFESSIONAL GROWTH 



When teachers and administrators communicate openly, important 
things can happen. Concerns and goals can be shared and eventual ly 
agreement reached. This is known as "coming to a common vision" and 
is the first step in a teacher evaluation program for growth. This 
module reviews the research which produced the publication Teacher 
Evaluation: Five Keys to Growth and the Teacher Evaluation Profile 
(TEP), a questionnaire describing teachers' perceptions of the 
evaluation environment. The module also addrasses the concept of 
common vision, presents a model for evaluation for growth, and 
provides training in the conducting of a planning conference. 

Anticipated Outcomes: 
Part icipants wi 1 1 - 

(1) gain an understanding of effective growth 
producing evaluation pract ces 

(2) develop an understanding of the need for a 
common vision 

(3) understand the basic concepts and purpose 
of a planning conference 

(4) become aware of the roles and feelings of 
the teacher and evaluator in the planning 
conference 




MODULE I AGENDA 



Act i vi ty 



Purpose 



Int roduct iori and Agenda 
Shar ing 



Introduce Evaluation 
for Growth 



CstabI i sh a Vision of 
Good Teaching and a NV)del 
of Growth Oriented Teacher 
Evaluat ion 



Preoare a Planning 
Conference 



Summary, Assignment, and 
Evaluat ion 



0 to introduce trainer and 

part icipants 
0 to establish a climate of openness 
0 to present module components and 

act i vi t ies 

0 to present research and 

effective practices in growth 
producing teacher evaluation 

0 to develop an understanding 
of the need for a common 
V i s ion 

0 to present a model of 
evaluat ion for growth 

0 to explain the purposes 
and elements of planning 
conferences and provide practice 
in conduct ing them 

0 to summarize main points 
0 to give observation assignment 
0 to allow participants to evaluate 
module 
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NODULE I: TRAINING AGENDA 
Approximate time: 2 hours, 15 Minutes 



Act ivi ty 

1. Introduction and 
Agenda Sharing 

0 introduce self and 
part icipants 

0 explain why training 
is being given 

0 distribute Module I 
Overview 

0 give overv iew of 
workshop activities 

0 ask for clarification 
quest ions 

0 discuss concerns 

0 present Workshop 
Themes 



Time 
15 min. 



Mater iais 

Handout: 

Module I Overview 
(H-l-1) 

Transparency: 

Workshop Themes (T- 



1-1) 



2. Presentation^: 
''Evaluation for 
Growth" 

0 present lecture 

0 ask for quest ions 



30 min. 



Transparencies: 

Teacher Centered 

Evaluation (T-1-2) 
Teacher Suggestions 

(T-l-3) 
Administrator 

Suggestions (T-1-4) 
Barriers (T-l-5) 
Keys to Growth (T-1-6) 
Teacher Evaluation 

Prof i le (T-l-7) 
Rese?*.rch Resu I ts 

(T-l-8) 



3. Develop a Comon 30 
Vision of Good Teaching 
and a Model for 
Evaluation 



min. Transparency: 

Keys to Training 
(T-l-9) 
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0 introduce concept of 
common vision 

0 divide group into 
smal I groups 

0 assign topic 

0 spokesperson selected 

0 teams report to large 
group 



4. The Planning 
Conference 

0 present lecture 

0 answer questions 

0 participants form 
teams 

0 teams discuss and list 
topics to cover in a 
planning conference 

0 team recorder I ists 
topics 

0 group with longest 
I i st repor ts 

0 present checklist on 
overhead 

0 answer questions 

0 distr ibute handout 

0 discuss element oi 
trust using handout 
(H-l-3) 

0 ask for two role play 
volunteers 



40 min. 



Transparencies: 

Important Aspects of 

the Planning 

Conference (T-l-10) 
Preobservat ion Planning 

Guide (T-l-11) 



Handouts: 

Preobservat ion Planning 

Guide (H-l-2) 
The Interpersonal 

Effect of Responses 

(H-l-3) 




0 after role play, 
invi te comments on 
appropr iate or 
inappropr iate 
behavior in the role 
play 

0 players respond to 
quest ions and report 
feel ings and problems 

0 faci I itate discussion 



5. Sunmary, Assignment, 10 
and Evaluation 

0 pass out Summary and 
Assignment handout 

0 review main points 

0 give assignment , 
answer quest ions, 
di st r ibute and 
col lect evaluat ion 
forms 



mm. Handout : 

Module I Summary 

Assignment (H-l-4) 
Evaluation Form (H-l-5) 



NOTE: Training supplies and equipment needed for Module I' 

0 Name Tags for Trainers and Participants 

0 Chartpack (opt ional ) 

0 Overhead Projector 

0 Marking Pens 

0 Paper and Pencils for Participants 
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Activity 1 



KODULE I 
INTRODUCTION 
AGENDA SHARING 



Purpose: 



Procedure: 



1. To introduce trainer and participants 

2. To establish a climate of openness 

3. To present module components and activities 



Trainer introduces self (and co-trainer). Have 
participants form groups of two and share name, position, 
school, and something interesting about themselves. Each 
group joins another group of two and introduces their 
partners. Groups of four introduce one another to the 
large group. 

Trainer distributes Module 1 Overview and reviews agenda 
with participants. (H-l-1) 

Option: Agenda items are written on chartpack as well. 

Trainer presents workshop themes of openness and 
col laborat ion. (T-l-1) 



WORKSHOP THEMES 
Use a team approach 

(Colleagues working together can accomplish far more than 
one individual. A major goal of the training is that 
solid collegial relationships will develop and remain 
long after the training has been completed.) 

Gather useful information on teaching performance 
(As participants complete the observation aisignments in 
each module and join in the debriefing sessions which 
follow, they will collect valuable information on 
effective teaching.) 
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Encourage commitment to improvement 
(Without encouragement, few would gain the commitment 
necessary to improve their skills. The training 
activities are designed to open participants* minds to 
new directions, break old boundaries, and eliminate the 
fear and apathy that can limit professional growth/ 

Link evaluation to professional development 
(Evaluation need not become a pro forma experience that 
is performed annually. With positive direction, 
evaluation can improve teacher effectiveness and bring 
about positive feelings between teach mg staff and 
administrators.) 



NOTES: 
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Activity 2 



MODULE I 
PRESENTATION 
"EVALUATION FOR GROWTH" 



Purpose: 

1. To present research and effective practices in growth 
producing teacher evaluation 

Procedure: 

1, Trainer presents lecture on teacher centered evaluation 
and the research supporting effective practices for 
teacher growth and professional development, A lecture 
example is given, but modifications may be made to 
accommodate the trainer's presentation style. 



POSSIBLE SCRIPT (adapt as needed to fit context) 

The research on teacher-centered evaluation has shown 
that when the evaluation process results in a teacher's 
individual growth and professional con^etence, several 
conditions must be in place. A teacher's individual 
needs become central to the process — those areas and 
goals that a teacher feels will support that teacher's 
professional development and enhance the teaching and 
learning process occurring in the classroom. 

To promote the potential for growth and development, a 
teacher needs support from the supervisor through 
meaningful classroom observations and feedback; support 
from col leagues in a peer evaluation program; positive 
input from students in the classroom, and a systematic 
sel f assessment of classroom activities. For this system 
to meet the needs of the teacher, sufficient resources 
and activities must also be provided over a period of 
time to stimulate and encourage that growth. (T-l-2) 

There is, however, much research to document the fact 
that teachers rarely derive any professional irrprovement 
from their participation in current evaluation 
programs. Research conducted at the Northwest Regional 
Educational Laboratory has attempted to determine why 
this is the case. Through this research, barriers to an 
effective growth producing evaluation have been 
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identified and a training program has been developed that 
increases the potential for teacher growth and 
development through the evaluation process, A brief 
sufTiTiary will help set the stage for the Teacher 
Evaluation Five Keys to Growth Training. 

The research consisted of three studies involving 
extensive interviewing and surveying of administrators 
and teachers and a thorough review of current research on 
teacher evaluation. The first study, conducted in four 
school districts, consisted of indepth interviews wi th 
teachers and supervisors, as well as responses to 
questionnaires on procedures and perceptions of 
evaluation effectiveness, 

NOTE: In preparing for this part of the presentation, 
the trainer should study the article entitled 
"Performance Assessment for Teacher Development" which is 
in the Appendix, 

In interviews, teachers and administrators made the 
following suggestions on how to improve the evaluation 
process: (T-l- 3) 



TEACHER SUGGESTIONS 

0 More collegial observation 

(an interchange of teacher to teacher; sharing 
information and observations) 

0 More sel f evaluat ion 

(not a general reflection but a systematic analysis 
of performance) 

0 Better performance criteria 

(better standards by which to be evaluated; areas 
that are important to me as a teacher; standards that 
are relevant on a day-to-day basis) 

0 More frequent observations 

(when observation does occur, it is often positive, 
but it doesn't happen often enough) 

0 Better evaluation training for supervisors 

(emphasis should be placed on feedback techniques) 

0 Better observation techniques 

(should be systematic and descriptive) 
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0 Effective communication 

(communication in a way that promotes trust in the 
evaluation process whether it is teacher to teacher 
or teacher to supervisor) 

0 Emphasis on improvement as opposed to accountability 
(in teacher's perception evaluation is primarily 
conducted for accountability purposes) 

0 Link to inservice training 

(when evaluation is for teacher growth, teachers can 
link their professional development goals to various 
ins''»'vice projects) 

The administrators made the following suggestions for 
improvement in the evaluation process: (T-l-4) 



ADMINISTRATOR SU(5GESTI0NS 

0 More trust 

(develop a system with trust that the program is for 




teacher growth) 



0 More t ime 

(need a system that has time to be involved with 
teachers and be in the classroom) 

0 More cooperation (vs adversary) 

(develop a cooperative program that encourages 
working together as opposed to a "them against us" 
feel ing) 

0 More training 

(administrators felt they needed continued training 
in observation procedures and feedback) 

0 Increased staff involvement 

(in planning and conducting the evaluation process 
instead of being perceived as an administrative task) 

0 District emphasis on improvement 

(emphasis on improvement and for staff growth and 
development; a visible public commitment to growlh; 
needs to come from the top down) 
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Accountability for evaluation 

(administrators were willing and anxious to be held 
accountable for evaluation if there was support by 
the district for training, staff involvement, etc.) 

As a result of vhe case studies and in collaboration 
with supervisors, teachers, and principals, the 
following barriers to growth oriented systems of 
evaluation were identified: (T-l-5) 



BARRIERS TO EFFECTIVE EVALUATION 

1. Lack of Skills in 

A. Evaluat ing 

B. Communicat ing 

2. Insufficient Time 

3. Processes that Protect Due Process may Inhibit 
Professional Development 

(by depriving the teacher of valuable feedback that 
may not meet the criteria of being legally defensible 
according to the collective bargaining agreement) 

4. Trust is Lacking 

The second study examined teacher growth from a different 
perspective. The study focused on teachers who reported 
that they had experienced professional growth as a result 
of a high quality evaluation experience. Only about 
thirty such cases could be identified for study, but the 
comparative analysis of each of these cases resulted in 
the identification of the following elements that were 
apparent in each of the successful evaluations. (T-l-6) 

Note: In preparing to do this phase of the presentation, 
the trainer should study the practioner's guide Teacher 
Evaluation: Five Keys to Growth . 



KEYS TO PROFESSIONAL GROWTH 
Attr ibutes of: 
THE TEAO<ER 

(expectations of a teacher for professional growth and 
development) 
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THE EVALUATOR 

(interpersonal relationship between evaluator and teacher 
and the training of the evaluator in teaching techniques 
and classroom observation) 

EVALUATION PROCEDURES 

(kinds of classroom data, e.g., observations, student 
achievement, appropriate standards of performance) 

FEEDBACK PROVIDED 

(quality and depth of suggestions provided in feedback) 
EVALUATION COT^TEXT 

(district program values growth as shown in context and 
time and resources allotted for effective evaluation) 

The third study was to determine if the attributes 
uncovered in the previous studies as necessary to a 
successful evaluation experience were related to the 
experiences of the general teacher population. A survey 
was conducted which asked over 400 teachers to describe 
their recent evaluation experiences in terms of the keys 
to success that had been identified in the previous 
studies: the teacher, the evaluator, data collection 
procedures, the feedback, and the evaluation context. 
Results verified that these five sets of attributes are 
indeed highly correlated with the quality and impact of 
the evaluation experience. 

Based on an analysis of these results, a questionnaire 
was developed, the Teacher Evaluation Profile (TEP), that 
can provice school districts with the following 
information on their teacher evaluation program: (T-l-7) 



TEACHER EVALUATION PROFILE 
(TEP) 

A Program Evaluation Instrument That: 

0 Describes the environment of teacher evaluation 

0 Evaluates the growth producing potential 

0 Diagnoses specific problems 

0 Provides specific training focus 

0 Tracks change over time 
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To summarize the research that forms the basis of this 
training: (T-l-8) 



TEAO€R EVALUATION RESEARCH RESULTS 

Teacher Evaluations Rarely Promote Growth 

Teachers Can Grow from Sound Evaluation 
Exper iences 

The Same Ev. 'nation System Cannot Serve Growth 
and Accountabi » ■ tv Purposes 

Keys to a Sound Growth System 

0 Teacher Open to Change 

0 Evaluator who has Credibility 

0 Sound Data Collection Procedures 

0 Effective Feedback 

0 Growth Oriented District Context 

0 District Procedures and Practices can change to 




Promote Growth 



Note: A description of the requirements and differences 
between an accountability system and a growth oriented 
evaluation system are described in the article "Teacher 
Evaluation- Accountability and Growth Systems - 
Different Purposes". This article is included in the 
Appendix and may be duplicated as a handout for 
discussion. 

2. At this point the trainer solicits questions and 
encourages interaction between participants and the 
trainer about the research presented in the lecture. 



NOTES: 
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NODULE I 

DEVELOPING A CONNON VISION OF A GOOD TEACHING 
MODEL OF GROWTH ORIENTED TEACHER EVALUATION 



Purpost: 



Procedure: 



1. To Oc -'lop an understanding of the need for a common 
V i s i on . 

2. To present a model of evaluation for growth. 



1. Trainer introduces concopt of common vision. 

Example: When teachers and administrators begin to talk 
about their mutual concerns, progress can result. 
Establishing mutual goals is establishing a common 
vision, one that can be worked toward together. 

All successful organizations, wheth-sr they be Disneyland, 
McDonalds, IBM, or a school systen., operate on a vision 
of success. This means all people involved, from the 
newest employee to the chairman of the board, have the 
same idea of what their organization should be, and each 
one works wholeheartedly toward that goal. That vision 
works most effectively when all share a common view of 
this goal. Therefore, before the process of teacher 
evalualion can begin, a common vision of good teaching 
must exist between administrator and teacher 

2. Trainer divides participants into teams and selects a 
topic to evoke discussion from team members on their 
vision of good teaching. 

Groups are to assume they are a team assigned to go irito 
a classroom and watch a teacher teach. They are to list 
the teacher behaviors that would illustrate the 
specified area indicated in the topic assignment. After 
the trainer assigns the topic, team members are asked to 
discuss the topic, come to a consensus, and select a 
spokesperson to report the team's conclusion to the large 
group. 
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Suggested Topics: 



(1) How would you determine the key characteristics of 
good teaching exhibited by the teacher? 

(2) What would you look for tc determine the methodology 
the teacher is using ir» addressing higher level 
thinking ski I Is? 

(3) What would you !ook for to determine the ways the 
teacher creates an interactive learning environment*? 



List each team's ideas on a chartpack. Trainer 
facilitates a discussion on each team's vision of good 
teaching. Trainer concludes activity by summarizing need 
for a common vision. 

Example; There is a need for a vision of good teaching. 
If there is no common vision, an observer will be less 
effective in providing meaningful feedback to the teacher 
following a classroom observation experience. 

^''io question to be answered is, '*What do I look for when 
! go into a classroom to look for good teaching?" This 
question can be answered when both the teacher and the 
supervisor have agreed upon a common vision of good 
teach ing. 



Trainer presents lecturette on visioning a model of 
teacher evaluation fo» growth. 

POSSIBLE SCRIPT (adapt as needed to fit the context): 

In teams, you have spent time sharing ideas of good 
teaching. From this communication, came a common vision, 
an agreement among you concerning the traits of good 
teaching. Wnen a vision is shared among members of any 
kind of group, they are able to move forward in pursuit 
of their mutually held goals 

Thus, a common vision of teacher evaluation, one that 
promotes professional growth, may be fostered among 
members of a teaching staff and administrators. The 
modules in this training are designed to acquaint 
participants with the total design of a growth oriented 
evaluation system. 




Based upon the collaborative effort of those it involves, 
it is dependent on open communication and a helping 
col legial att i tude. 

We begin in Module I with the planning conference; Module 
II introduces classroom observation, and Module III 
presents delivery of feedback in the post conference. 
The fourth module discusses other sources of data, and 
final ly. Module V deals with goal setting and steps 
towards implementation of a program of evaluation for 
growth in your own school. 

The success of training is tied to participant 
involvement . (T-l-9) 

KEYS TO TRAINING 
Part icipants wi 1 1 der ive maximum benefit when they: 

1. Participate in all segments of the training, 

2. Do the assignments - all are activities to be 
conducted rather than written tasks. 

3. Interact with one another - teacher to tearher, 
teacher to supervi sor . 

4. Talk with trainers - ask questions, share 
experiences, and tell us how things are going. 

5. Trust each other - take risks; do things not done 
before; be vulnerable and open, frank and honest, 
not just in the sessions, but in the assigned 
act iv i t i es. 

5. Trainer facilitates discussion of this vision as 
appropr iate. 



NOTES: 



Activity 4 



NODULE I 
THE PLANNING CONFERENCE 



Purpose: 



Procedure: 



1. To explain the purpose and elements of planning 
conferences 

2. To provide practice in conducting conferences. 



Trainer presents lecturette on Important Aspects of the 
Planning Conference. 

POSSIBLE SCRIPT (adapt as necessary): 

The planning conference is an essential step in the 
evaluation process. Because it clarifies the 
instructional setting, determines -the focus of the 
observation, selects a recording method, and most 
important of all, establishes trust between the teacher 
and observer, it influences everything that follows. If 
the planning conference is successful, the observation 
and the delivery of feedback will proceed equally as well 

Approach the planning conference with an attitude 
envisioning growth, one that acknowledges the teacher as 
a competent professional and the observer as a fellow 
educator rather than a judge. There are other important 
aspects to consider: (T-l-10) 



IMPORTANT ASPECTS OF THE PLANNING CONFERENCE 

0 Use a preobservat ion planning guide 

(To insure that no valuable information is left out, a 
planning guide concerning relevant aspects of the 
classroom, the students, the lesson, and the course is 
useful . ) 

0 Keep it informal 

(Find a place where both parties feel comfortable.) 
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0 Understand conditions 

(The observer should be familiar with the classroom 
to be observed, both the physical setting and the 
kind of students who inhabit it. Earlier visits 
before observation are recommended,) 

0 Articulate intentions 

(The teacher designates exactly who or what is to be 
observed and why.) 

0 Avoid concentrating on problem areas 

(In fact, there may be no significant problems. 
Consider observing an aspect the teacher feels is a 
strength ) 

0 Decide on an observation tool 

(Select or design together a format to be used in 
recording the designated behaviors.) 

Trainer has participants group in teams formed earlier. 

The group assignment is to list topics to cover in a 
planning conference. One team member serves as recorder. 

After 10 minutes, the trainer asks . ams the number o^ 
topics listed. The team with the highest number is asked 
to read the team*s list. Trainer asks for additions from 
other teams and facilitates di;>^ussion as appropriate. 



Trainer discusses the Preobse» vat ion Planning Guide from 
the overhead and distributes handout. (H-U2) (T-l-11) 

Example: The following is an exampie of a planning 
guide. It covers information that is important and 
useful to both the observer and the teacher. 



PREOBSERVATION PLANNING GUIDE 

0 Learning Objectives of the Lesson 

(What does the lesson attempt to teach*?) 

0 Student Pre-Knowledge 

(Have the students already learned something about 
this topic? To what extent?) 
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0 Anticipated Interactions 

(Will it be teacher to whole group, teacher to 
individual students, students to other students, or a 
combination?) 

0 Questioning Strategies 

(Wh^. kinds of questions will be asked; what thinking 
levels addressed?) 

0 Assessment Methodology 

(What formal and/or informal methods will be used to 
assess student learning*^) 

0 Class CI imate 

(What is the general attitude of the class'^) 

0 Special Concerns 

(Are there students with special needs or conditions 
that are of concern?) 

0 Desired Observation Focus 

(What or who will be observed and what kind of data 
should be recorded?) 

Trainer summarizes use of the planning guide and stresses 
the importance of trust in the observer/teacher 
relat ion ship. 

POSSIBLE SCRIPT (adapt as necessary): 

Example: The Preobservat ion Planning Guide is merely a 
rer.ii'nder to insure that important information is shared. 
It should not become a supervisor's interviewing tool. 
The Planning Guide should be a tool for both parties to 
review and discuss as equals. 

Trust, as indicated earlier, is a necessary element 
throughout the evaluation process. It will not magically 
exist simply because two parties have willed it so. Each 
must prove to the other that the relationship is safe and 
the intentions are trustworthy. A willingness to take 
risks by opening up avenues for change, expressing honest 
feelings, and relinquishing power will also promote 
trust. It does not develop easily, but until it does, 
there is little chance for openness and growth. 

John L. Wallen. Social Psychologist, has developed a list 
of behaviors that can open a relationship to trust and 
those that can stifle trust through subordination. The 
list can serve as a useful guide in conferences. 
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especially when one meniber is in a suporvisory position. 
(Trainer presents "The Interpersonal Effect of Various 
Responses" (H-l-3) and elicits questions and comments 
from the group.) 



THE INTERPERSONAL EFFECT OF VARIOUS RESPONSES 

FREEING EFFECTS: Increases other's autonomy as a person; 
increases sense of equality. 

Active, attentive listening : Responsive listening, not 
just si lence. 

Paraphrasing : Testing to insure the message you receive 
is the one sent. 

Perception check : Showing your desire to relate to and 
understand him/her as a person by checking your 
perception of an inner state; showing acceptance of 
feel ings. 

Seeking information to help vou understand the person: 
Questions directly relevant to what was said, not 
questions that introduce new topics. 

Offering information relevant to the other's concerns : 
Information may or may not be used. 

Sharing information that has influenced your feelings and 
V i ewpo in t s . 

Directly reporting your own feelings . 

Offering new alternatives : Action proposals offered as 
hypotheses to be tested 
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3INDING-CUEING EFFECTS: Diminishes other's autonomy by 
increasing sense of subordination. 

Changing the subject without explanation : For example, 
to avoid the other's feelings. 

Explaining the other, interpreting his behavior : "You do 

that because your mother always " Binds the pet son to 

past behavior or may be seen as your effort to get the 
person to change. 
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Vigorous agreement : Binds the person to his/her present 
position—limits the option o: changing one*s mind. 

Expectations : Binds the person to the past. "You never 
did this before. What's wrong?" Cues the person to 
future action, "Tm sure you wi 1 1 ..." "I know you can 
do it." 

Denying the person's feelings : "You don't really mean 
that!" ... "You have no reason to f^el that way." 

General ization : "Everybody has problems like that." 

Ap proval on personal grounds : Praising the other for 
thinking, feeling or acting in ways that you want him to, 
that is. for conforming to your standards. 

Disapproval on personal grounds : Blaming or censuring 
the other for thinking, acting, and feeling in ways in 
which you do not approve. 

Commands, orders : Telling the other what to do. 
Includes, "Tell me what to do!" 

Emotional obi igations : Control through arousing feelings 
of shame and inferiority. "How can you do th s to me 
when I have done so much for you?" 

THE EFFECT OF ANY RESPONSE DEPENDS UPON THE DEGREE OF 
TRUST IN THE RELATIONSHIP 

The less trust, the less freeing effect from any response. 
The more trust, the less binding effect from any response. 

^Adapted from Wall en, John, Systematic and 
Objective Analysis of Instruction . Port land, 
Oregon: Northwest Regional Educational 
Laboratory, 1965, page 93. 

5. Trainer asks for two volunteers for a role play, one to 
play the teacher, one to play the observer. If 
participants are reluctant to volunteer, the trainer may 
encourage them. 

Example: The teacher may use his/her own teaching 
situation or may fabricate a different one, and both 
teacher and observer may use the Preobservat ion Planning 
Guide handout as a prompt. This activity does not call 
for a flawless planning conference. It is simply a 
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method to develop group discussion. Volunteers are given 
a few moments to plan their roles together. 

The role play takes place. Those performing are in a 
position where they can be heard and seen by all 
participants. Trainer terminates role play if it goes 
longer than 10 minutes. 

At conclusion of role play, trainer facMitates 
discussion. Trainer asks group for comments on the 
role-played conference, and asks role players to share 
with the group their feelings and problems as they worked 
through the scene. 

Example: Who did you think was leading the discussion'? 
How did you feel about that? Did the feeling of equality 
between you exist or did it seem like a 
superior/subordinate interaction? Did you find the 
Preobservat ior Planning Guide useful or a barrier'? What 
questions in the conference were most difficult to 
handle'? In what way was the conference productive'? Was 
trust evident in the interchange? Do you feel that a 
successful observation will follow this conference? 

Trainer summarizes by again stressing the importance of 
the planning conference. 

Example - The planning conference provides the teacher 
and observer an opportunity of meeting to discuss a key 
to instructional improvement. That key is to plan an 
observation activity that focuses on what is occurring 
with children and with the teacher in the classroom 
setting. When an attitude of col legiai i ty, trust, and a 
common vision of good teaching are shared between teacher 
and obi;er* r, there is potential for an observation that 
will provide the teacher with effective feedback 
promot ing growth. 



NOTES: 
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NODULE I 

SUIWARY, ASSIGNMENT, AND EVALUATION 

1. To summarize main points 

2. To give observation assignment 

3. To allow participants to evaluate module 



Purpose: 



Activity 5 



Procedure: 



1. Trainer distributes Module I Summary and Assignment. 
{H-l-4) 

2. Trainer reviews summary and assignment. 
Summary: 

1. Teacher evaluation as prccticed in most schools was 
not a satisfactory growth producing activity to 
either teachers or administrators. 

2. NWREL researchers found five keys to teacher 
evaluation for professional growth: attributes of a) 
the teacher, b) the evaluator, c) the evaluation 
procedures, d) feedback provided, and e) the 
evaluat ion context . 

3. Teachers and administrators can arrive at a common 
vision of good teaching through open communication. 

4. Training provides a model of teacher evaluation for 
growth . 

5. The planning conference, requiring trust and open 
communication between teacher and observer, has 
important aspects to consider. 

Ass ignment : 

Hold a preobservat ion planning conference with a 
fellow educator using the information given in this 
module. Observe the class and record behavior using 
an anecdotal method. Data should be descriptive with 
all judgment withheld. Afterwards, give the data to 
the teacher for analysis and interpretation. 
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3. Trainer answers questions. Most questions will focus on 
the assignment. 

Example: Anecdotal notetaking is simply recording what 
is said and done without inference or judgment. Meet 
vith the teacher to determine the kind of activity that 
will be recorded in a simple, easy to read, and 
interpretive manner. After you have completeo the 
observation, give the results of your efforts to the 
teacher, leaving the interpretation to him/her. Some 
discussion may be necessary, but, again, remind yourself 
to withhold judgemeri'. 

4. Trainer distributes Evaluation Forms (H-l-5) and collects 
on completion. 



NOTES: 
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(H-l-1) 



MODULE I - OVERVIEW 
SEHING THE STAGE 
TEACHER EVALUATION FOR PROFESSIONAL GROWTH 



When teachers and administrators communicate openly, important 
things can happen. Concerns and goals can be shared and eventually 
agreement reached. This is known as "coming to a common vision" and 
is the first step in a teacher evaluation program for growth. This 
module reviews the research which produced the publication Teacher 
Evaluation: Five Keys to Growth and the Teacher Evaluation Profile 
(TEP), a questionnai re describing teachers' perceptions of the 
evaluation environment. The module also addresses the concept of 
common vision, presents a model for evaluation for growth, and 
provides training in the conducting of a planning conference. 

Ant icipated Outcomes. 
Par t icipants wi I I - 

(1) gain an understanding of effective growth 
producing evaluation practices 

(2) develop an understanding of the need for a 
common v i sion 

(3) understand the basic concepts and purpose 
of a planning conference 

(4) become aware of the roles and feelinys of 
the teacher and evaluator in the planning 
conference 
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(H-l-1) 



MODULE I AGENDA 



Activity 

Introduction and Agenda 
Shar ing 



Introduce Evaluat ion 
for Growth 



EstabI ish a Vision of 
Good Teaching and a Model 
of Growth Oriented Teacher 
Evaluat ion 



Prepare a Planning 
Conference 



Sunmary, Assignment, and 
Evaluat ion 



Purpose 

0 to introduce trainer and 

part icipants 
0 to establish a chmate of openness 
0 to present module components and 

act i vi t ies 

0 to present research and 

effective practices in growth 
producing teacher evaluation 

0 to develop an understanding 
of the need for a common 
vision 

0 to present a model of 
evaluation for growth 

0 to explain the purposes 
and elements of planning 
conferences and provide practice 
in conduct ing them 

0 to summarize main points 
0 to give observation assignment 
0 to allow participants to evaluate 
module 
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PREOBSERVATION PLANNING GUIDE 



Teacher Subject, 

Date/Time of Observation 

Lesson to be Taught^ 



Observer 



1. Learning Objectives of the Ler;son_ 



2. Student P re-Know I edge_ 



3. Anticipated Interact ions_ 



4. Questioning Strategies^ 



5. Assessment Methodology, 



6. Class CI imate 



7. Special Concerns^ 



8. Desired Observation Focus_ 
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(H-l-3) 

THE INTERPERSONAL EFFECT OF VARIOUS RESPONSES 



FREEING EFFECTS: Increases oiher's autonomy as a person; increases 
sense of equal i ty . 

Act ive, attent ive I i stening : Respor.. listening, not just 
SI lence. 

Paraphrasin g: Testing to insure the message you receive is the 
one sent . 

Percept ion check : Showing your desire to relate to relate to 
and understand him/her as a person by checking your perception 
of an inner state; showing acceptance of feelings. 

Seeking information to help you understand the person : 
Questions directly relevant to what was said, not questions 
that introduce new topics. 

Offering information relevant to the other's concerns : 
Information may or may not be used. 

Sharing information that has influenced your feelings and 
viewpoints . 

Directly reporting your own feelings . 

Offering new alternatives : Action proposals offered as 
hypotheses to be tested. 

BINDING-CUEING EFFECTS: Diminishes other's autonomy by increasing 
sense of subordination. 

Changing the subject without explanation : For example, to 
avoid the other's feelings. 

Explaining the other, interpreting his behavior : "You do .nat 

because your mother always " Binds the person to past 

behavior cr may be seen as your effort to get the person to 
change. 

Vigorous Agreement : Binds the person to his/her present 
posi t ion— I imi ts the option of changing one's mind. 

Expectations : Binds the person to the past. "You never did 
this before. What's wrong'?" Cues the person to future 
action, " I 'm sure you wi 1 1 . ..." "I know you can do i t ." 
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Denying the person's feelings : *'You don't really mean 
that'" "You have nc reason to feel that way." 

General izat ion : ^'Everybody has problems like that.*' 

Approva l on personal grounds : Praising the other for 
thinking, feeling or acting in ways that you want him 
to. that is, for conforming to your standards. 

Disapproval on personal grounds : Blaming or censuring 
the other for thinking, acting, and feeling in ways in 
which you do not approve. 

Commands, orders : Telling the other what to do. 
Includes, "Tell me what to do!" 

Emot ional obi igat ions : Control through arousing 
feelings of shame and inferiority. "How can you do 
this to me when I have done so much for you'^" 

THE EFFECT OF ANY RESPONSE DEPENDS UPON THE DEGREE OF TRUST 
IN THE RELATIONSHIP 

The less trust, the less freeing effect from anv response 

The more trust, the less binding effect from any response. 

*Adapted from WaMen, John, Systematic and 
Objective Analysis of Instruction. Portland, 
Oregon: Northwest Regional Educational 
Laboratory, 1965, page 93. 
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MODULE I. SETTING THE STAGE 
TEACHER EVALUATION FOR PROFESSIONAL GROWTH 
Summary and Assignment 



Summary : 

1. Teacher evaluation as practiced in most schools was not a 
satisfactory growth producing activity to either teachers 
or administrator. 

2. NWREL researchers found five keys to teacher evaluation for 
professional growth: attributes of a) the teacher b) the 
evaluator. c) the performance information, d) feedback 
provided, and e) the evaluation context. 

3. Teachers and administrators can arrive at a common vision 
of good teaching through open communication. 

4. Training provides a model of teacher evaluation for growth. 

5. The planning conference, requiring trust and open 
coimiunicat ion between teacher and observer, has important 
aspects to consider . 



Assignment : 

Hold a preobservat ion planning conference with a fellow 
educator using the information given in this module. Observe 
the class and record behavior using an anecdotal method. Data 
should be descriptive with all judgment withheld. Afterwards, 
give the data to the teacher for analysis and 
interpretat ion. 
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TEACHER EVALUATION TOR GROWTH 
Setting the Stage 
l4odule I Evaluation 



> 
o 



LU 
> 



1, What overall rating of effectiveness would you 1 
give this module in meeting the outcomes 
ident i f ied ear I ier'? 

2. How effective were the transparencies in 1 
providing you with an understanding of the topic'^ 

3, How effective were the handouts in providing you 1 
with an understanding of this topic'^ 

4, How effective was the process or design used in 1 
this m'-'-^ut^ in helping you to understand the topic? 

5. How effective were the activities and information 1 
provided m helping ydu plan for a teacher 
evaluation program for growth'^ 

6. How effective were the trainers in presenting the 1 
information and skills in this module'^ 

1. What activities in this training session were most effective in 
understanding the concepts presented in this module'? 
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2. What specific reconmendat ions would you make for subsequent training 
sessions of this module'? 



3. Do you have other comment s"? 
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WORKSHOP THEMES 



• Use a team approach 

• Gather useful information on teaching 
performance 

• Encourage commitment to improvement 

• Linic evaluation to professional development 



flOrinVVNI 

RMtonal 
EducctkHwi 
Labonrtory ( 
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(T-I-2) 



gACHER-CENTERED EVALUATION 



Supervisor 



Colleagues 



Educational 
Laboratory 



Grovyrth 

A 



Resources 




SeK-Assessment 



Students 



ERIC 



33 



(T-I-3) 




TEACHER SUGGESTIONS 



• More collegial observation 

• More self evaluation 

• Better performance criteria 

• More frequent observations 

• Better evaluation training for supervisors 
Better observation techniques 
Effective communication 

• Emphasis on improvement as opposed to accountability 
Link to inservice training 



EduMtlonil 
Laboratory < 
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(T-I-4) 

ADMINISTRATOR SUGGESTIONS 



• More trust 

• More time 

• More cooperation (versus adversary) 

• More training 

• Increased staff involvement 

• District emphasis on improvement 

• Accountability for evaluation 



EduMtSnai/ W\ 
Laboratory ^^^^^ 
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BARRIERS TO EFFECTIVE 
EVALUATION 



1. Lack of Skills 

• Evaluating 

• Communicating 



2. Insufficient Time 



3. Processes Promote Due Process; Inhibit 
Professional Development 



4. Trust Is Lacking 



I EdueatloMi 



Ubonrtoryl 
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(T-I-6) 




KEYS TO PROFESSIONAL GROWTH 



• The Teacher 

• The Evaluator 

• Evaluation Procedures 

• Feedback Provided 

• Evaluation Context 



Attributes of : 



nonnwNi 

Educatioiwi 
Laboratory! 
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TEACHER EVALUATION PROFILE 



A ProaraiT. Evaluation Instrument that: 

• Describes the environment of teacher 
evaluation 

• Evaluates the growth producing potential 

• Diagnoses specific problems 

• Provides a training focus 

• Tracks change over time 



(TEP) 



fteglonit 
EducationtI 
Laboratory^ 



.A 
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(T-I-C) 



TEACHER EVALUATION RESEARCH 

RESULTS 

Teacher Evaluations Rarely Promote Growth 

Teachers can Grow from Sound Evaluation 

• The Same Evaluation System Cannot Serve Both Growth 
and Accountability Purposes 

Keys to a Sound Growth System 
-Teacher open to change 
-Evaluator who has credibility 
-Sound data collection procedures 
-Effective feedbacic 
-Growth oriented district context 

District Procedures and Practices can Change to Promote 
Growth 



NorthwMt 

EdSSitional/ \\\ 
Laboratory ^^^^^^ 
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KEYS TO TRAINING 

1 . Participate in all segments of the training 

2. Do the assignments 

3. Interact with one another 

4. Talk with trainers 

5. Trust each other 



Laboratory ^^^^^^ 



40 



(T-I-10) 



IMPORTANT ASPECTS OF THE 
PLANNING CONFERENCE 



Use a preobservation planning guide 



Keep it infonnal 



Understand conditions 



Articulate Intentions 



Avoid concentrating on problem areas 



Decide on observation tool 



Educational 
Laboratory 



4\ 
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(T-I-11) 



PREOBSERVATION PLANNING GUIDE 



Learning Objectives of the Lesson 



Student Pre-Knowledge 



Anticipated Interactions 



Questioning Strategies 



Assessment Methodology 



:ass Climate 



Special Concerns 



Desired Observation Focus 



Laboratory W^^^^ 
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MODULE II. COLLECTING OBSERVATIONAL DATA 



"OBSERVING IS MUCH MORE THAN SEEING. OBSERVING 
INVOLVES THE INTENTIONAL AND METHODICAL VIEWING 
OF THE TEACHER AND STUDENTS. OBSRVING 
INVOLVES PLANNED, CAREFUL, FOCUSED AND ACTIVE 
AHENTION BY THE OBSERVER." 

R. HYMEN, SCHOOL ADMINISTRATOR'S HANDBOOK OF 
TEACHER SUPERVISION AND EVALUATION METHODS 



NODULE II OVERVIEW 
COLLECTING OBSERVATIONAL DATA 



When teachers are given specific, accurate, descriptive data on 
classroof.' instruction, part icular ly when the focus is ori aspects the 
teacher selected, there is motivation to change, take risks, and 
improve classroom instruction. Therefore, to facilitate teachers' 
professional growth, classroom observation must be teacher directed, 
specific, and accurate Module 1 1 informs participants of the kinds 
of classroom behavior that can be recorded through observation, 
familiarizes them with the use of a number of common observational 
tools, and demonstrates the utility o* teacher-made observation 
too 

Anticipated Outcomes: 

Part icipants wi 1 1 - 

(1) learn various methods of collecting 
observational data 

(2) learn how to select an appropriate 
observational tool 

(3) learn the advantages and disadvantages of 
various data collecting methods 

(4) understand the characteristics of good data 

(5) design observation tools, use them, and 
cr i t ique them 
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NODULE II AGENDA 



Act i vi ty 



Purpose 



Introduction, Agenda 
Shar ing, Debr ief ing 



Methods of Collecting Data 



0 to introduce or reacquamt trainer 

and part icipants 
0 to review agenda items and allow 

for comments and questions 
0 to allow participants to share 

observation experience 

0 to familiarize participants with 
common data collecting methods 

0 to provide practice usino 
Selective Verbatim 



Using Observation Tools 



Summary, Assignment, and 
Evaluat ion 



0 
0 



to provide practice in using 
observat ion tool s 
to clarify the characteristics of 
good data 

to provide p.actice in designing 
and critiquing observation tools 

to summar ize module 

to assign observation task 

to allow participants to evaluate 

module 
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Module II: TRAINING AGENDA 
Approximate time: 2 hours, 30 ninutes 



Activity T ime Mater iais 

1 . I nt roduct I on , Agenda 35 m i n . Handout : 

Sharing, Debriefing Module II Overview 

^ (H-ll-i) 

0 introduce sel f and 
co-trainer 

0 part icipants 

introduc- selves i f 
appropr iate 

0 distr ibute Module 
1 1 Overview and 
Agenda 

0 present overview 
of module activities 

0 ask for quest ions 




0 discuss concerns 



0 teams form to share 
observat ion 
experiences from 
Module I assignment 

0 each group selects 
spokesperson 

0 groups report 

0 record comments 
on chartpack 

0 faci I i tate di s- 
cuss ion 



2. Methods of Collection 

0 explain concept of 
descr ipt ive versus 
judgment 



40 min. 



Transparencies: 

Descr i pt i ve/Judgment 

(T-ll-1) 
Methods of Col lect ion 
(1-11-2) 
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0 present lecturette 
on methods of 
col lect ing data 

0 prese'it lecturette 
on select ive verbat im 

0 ask for quest ions 

0 pass out observation 
forms 

0 ask teams to determine 
a verbal interact ion to 
record 

0 participants record data 
from video 

0 faci I i tate discussion on 
data gathering 

0 summar ize act i vi ty 



Select ive Verbat im 
Suggest ions (T-l 1-3) 

Handouts : 

Select ive Verbat im 
Transcript (H-l 1-2) 

Observation Form 
(H-l 1-3) 

Wide Lens Approach 

(H-l 1-4 opt.) 



3. Using Observation Tools 

0 distribute packet 
of observat ion tool s, 
explain 

0 teams meet, each 
member chooses a tool 
to se 

0 part icipants record 
data from video tape 



0 faci I i tate discussion 

0 distribute packet of 
mapping tools, explain 

0 present lecturette on 
good data 

0 ask for questions 



65 min. 



Handouts: 

Packet of Observation 

ToJs (H-l 1-5,6,7,- 

8,9,10) 
Packet of Mapping Tools 

(H-l 1-11,12,13) 
Classroom Si tuat ions 

(H-l l-14-opt,) 



Transparencies: 

Characteristics of Good 

Data (T-l 1-4) 
Observat ion Tool 

Critique (T-ll-5) 
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distribute blank 
paper and ask 
participants to 
design an 

observation tool to 
be used in a specific 
classroom 

participants design 
tool 

teams meet and 
share designs 

team selects one 
design to put on 
transparency and 
share with large 
group 

designs shared using 
overhead 



0 faci I i tate di scussion 



4. SuMMiry, Assignment 
and Evaluation 



0 distribute 
handouts 

0 respond to questions 



0 di str ibute evaluat ion 
forms and col lect on 
complet ion 



10 min. 



Handouts : 

Module 1 1 Summary 
and Assignment 
(H- 1 1-15) 

Evaluat ion Forms 
(H-ll-16) 
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NOTE: Training supplies and equipment needed for Module II 

0 Overhead Projector 

0 Video Cassette Recorder 

0 Classroom Observation Videotapes (2) 

0 Chartpack 

0 Marking Pens 

0 Transparency Pens 

0 Blank Transparencies 

0 Paper and Pencils for Participants 

0 Videotape of Teaching Segments 
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Activity 1 



Purpose: 



Procedure: 



NODULE II 
INTRODUCTION 
AGENDA SHARING AND DEBRIEFING 



1. To introduce or re-acquaint trainers and participants 

2. To review agenda items and allow for comments and 
quest ions 

3. To allow participants to share observation experience 



1. If this is the first meeting, trainer introduces se I f and 
co-trainer and has participants give name, position, and 
school . 

2. Trainer explains purpose of training and describes where 
participants are in the course. 

3. Trainer distributes Module II Overview and Agenda 
(H-ii-1), goes over agenda, and asks for questions or 
concerns. 

Option: Agenda may be written on chartpack. 

4. Teams as formed in Module I meet for 15 minutes to 
discuss observation experiences from assignment in Module 
I. Spokesperson is selected to present highlights. 

5. Spokespersons report to large group as trainer writes 
comments on chartpack. 

6. Trainer facilitates discussion as appropriate. 



NOTES: 
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Activity 2 



Purpose: 



Procedure: 



NODULE II 
METHODS OF COLLECTING DATA 



1 . To fami I iar ize part icipants wi th common data col lect i ng 
methods 

2. To provide practice using Selective Verbatim 



Trainer presents lecturette on methods of collecting data. 

POSSIBLE SCRIPT (adapt as needed to fit context) 

Classroom activity can be recorded in many different 
ways. The teacher and observer will determine in the 
planning conference the methodology to use. The observer 
functions a great deal as a video recorder would. The 
video camera simply records what it sees and hears but 
makes no judgments or inferences. The same should be 
true for the observer who records descriptive, not 
judgmental, data. For example, descr ipt ive data might 
read ''Teacher called on three girls and eight boys." 
Judgmental data of the same classroom event might read 
•'Teacher favors boys.'* 

The following presents sentences taken from observation 
data. Are they descriptive or judgmental (T-ll-1) 
(Trainer has participants respond to each statement.) 

DESCRIPTIVE vs JUCKSMENT 

0 Teacher takes five minutes to take roll; three 

changes made as students arrive late, (descriptive) 

0 Visual aids used in presentation are too small, 
(judgmental ) 

0 Teacher's tone of voice is harsh and eyes are 
unf r iendly. (judgmental ) 

0 Teacher spent 30 minutes of classtime seated at 
desk, (descr ipt ive) 

0 Teacher handles discipline well, (judgmental) 
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0 Three students expressed inability to read 
handwriting on board, (descriptive) 

Careful attention is needed to objectively record only 
what is said and done. This is difficult to do. Much 
depends on the observation tool selected and the 
information shared in the planning conference. 

The following are conrnonly used methods to record 
classroom instruction: (T-ll-2) 



METHODS OF DATA COLLECTION 
Verbatim 

(A written r=;cord of verbal interaction in the 
classroom. Practice is necessary to develop the 
skill of taking verbatim. Observers find that 
developing a personal shorthand style is helpful.) 

Select ive Verbat im 

(Selects only one part of the verbal exchange such as 
the teacher's questions, control statements, positive 
reinforcement, etc.) 

Videotaping . u. u 

(Collect now; view later; particularly valuable when 
the tape is left with the teacher.) 

Audio taping 

(Often used in conjunction with a classroom 
observation to support a written record. Placement 
of machine is crucial . ) 

Wide Angle Notation 

(Brief descriptive notes on classroom instruction and 
management with comments giving overall impressions.) 

Observing Behavior 

(Descriptive recording of what is said and done in a 
classroom, usually restricted to certain behaviors.) 

a. Counting - (how many) 

b. Coding - (what kind, not as descriptive as 
count ing) 

c. Checking - (checking if something is present or 
absent; problems occur when shades of gray exist 
and yes/no answer is not applicable) 
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d. Rating - (based on established criteria on each 
rating of the snale) 

e. Mapping - (map of the classroom is drawn and data is 
entered showing physical movement or verbal exchange) 

2. Trainer asks for clarification questions. 

3. Trainer explains Selective Verbatim. 

Example: Selective Verbatim is a relatively simple- 
method of recording observation data and provides the 
teacher and observer with valuable information. During 
the preobservat ion conference* the observer and teacher 
select one aspect of verbal exchange on which to collect 
data. Among the selections might be teacher's questions, 
student responses, management statements, or habitual 
remarks. The observer only records the agreed upon 
data. 

The data are specific and nonjudgmental and provide the 
teacher with a pattern of data that focuses on an area of 
particular interest or concern. Because it is selective, 
concentrating on only one part of the verbal interaction, 
other important activities or events occurring in the 
classroom are omitted. The observer often discusses with 
the teacher the option of noting other events that 
occur . 

Selective verbatim notes can be recorded on any kind of 
blank paper as they really do not need a specific 
format. However, the selective verbatim transcript I am 
passing out uses a special form that allows pertinent 
information to be included at the top. (Trainer 
distr ibutes Select ive Verbat im t^ar.script H-ll-2.) The 
teacher and observer have agreed tha' *he observer will 
record the teacher's positive comments and feedback to 
students. In recording, the observer noted the time and 
the positive or encouraging remarks given to students. 
This form also allows for observer comments in th. right 
column. 

Option: An alternate suggestion is the use of the Wide 
Angle Notation observation tool. 

E>^ample: Another method of observation is commonly 
called "wide angle. The wide angle notation records 
activities as they occur in the classroom. General 
comments are written on a form such as the one being 
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passed out. Care should be taken to insure the 
objectivity of the comments. 

4. Trainer distributes Selective Verbatim form (H-ll-3) 
and/or Wide Lens Approach (H-ll-4 opt.) 

5. Trainer asks participants in teams to determine a 
classroom verbal interaction to rocord using selective 
verbatim (or to prepare to practice wide lens approach) 
while watching a video tape of a ciass in session. 

Example: Now you will have the opportunity to record 
data using selective verbatim (or wide lens approach) 
while watching a video of an instructional situation. In 
your teams, determine some form of verbal interaction (if 
using selective verbatim) for each team member to 
record. Some suggestions are as follows: (T-ll-3) 



SELECTIVE VERBATIM 

0 Teacher Quest ions 

0 Studer i Quest ions 

0 Positive Reinforcement 

0 Student Responses 

0 Control Statements 

0 Habitual Remarks 

0 Off Task Digressions 

If the interaction becomes so rapid that it is difficult 
to record all remarks, record an incomplete phrase, 
statement, or question, and use a notation to show where 
some material was omitted. 

6. Trainer plays video tape; approximately five to ten 
minutes. Participants record selected verbal 
interact ions. 

7. Trainer debriefs after activity centering on tht 
usefulness of the method when the focus is chosen 
careful ly. 



NOTES: 
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Activity 3 



MODULE II 
USING OBSERVATION TOOLS 



Purpose: 



Procedure: 



1. To provide practice using observation tools 

2. To clarify the characteristics of good data 

3. To provide practice in designing observation tools 



Trainer distributes packet of observation tools and 
explains their use. (H-l 1-5,6,7,8,9,10) 

Example: To provide meaningful data that will result in 
the improvement of instruction, the observat ion tool is 
selected by the teacher and observer in the planning 
conference. The specific data gathering instrument used 
depends upon the classroom behaviors to be observed and 
recorded. 

Consideration is given to the lesson that tne teacher 
will be teaching, the physical arrangement of the room, 
the skill levels of the students, the teaching strategies 
to be used, and the particular concerns or interests of 
the teacher . 

The observation tools being distributed are regularly 
used in the classroom and provide meaningful data to the 
teacher. (Review each of the data gathering instruments 
in the packet and discuss how they can be used in a 
classroom. ) 



(H-ll-5) Teacher Use of Time - (Records amount of 
teacher time spent in various activities such as 
classroom business, discipline, individual instruction, 
group instruction, assessment, teacher non-mteract ive. ) 

(H-l 1-6) Teacher Questioning and Response Behavior - 
(Records number of questions asked, kinds of questions, 
and responses. ) 

(H-l 1-7) Behavior Management - (Records nature and 
number of class disciplinary occurrences with student ai J 
teacher reactions.) 
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(H-l 1-8) Teacher Behavior Tal ly - (Tal I ies a variety of 
teacher behaviors frofn smiling to correcting student's 
behavior . ) 

(H-l 1-9) Student Classroom Activities - (Records number 
of times focus shifted in class and amount of time used 
in such trans i t ions. ) 

(H-M-10) Classroom Discussion - (Records teacher and 
student interaction in a discussion activity.) 



Trainer instructs participants to review tool in teams, 
each member selecting one to use while watching a 
cl assroom v ideo. 

Trainer shows video, approximately five to ten minutes. 
Each participant records observation data using one of 
the tools in packet. 

After the video, trainer elicits comments and facilitates 
discussion concerning observations 

Example: Recording data in a classroom is more than 
simply observing and listening. It takes concentration 
and professional knowledge, though notes are to be 
descriptive and objective, sometimes the observer is 
required to diotinguich between positive and neutral 
feedback or to determine whether a response was 
antagonistic or friendly. "Joking" to one person may be 
"ridicule" to another. At times it may be difficult to 
decide whether a teacher is ignoring misbehavior or is 
unaware of it. When instances such as these are in 
question, the observer simply notes the occurrence 
without casting judgment. These questions are clarified 
at the post observation conference. 

Trainer distributes the second packet of observational 
tools and explains how each is used. (H-ll-11, 12, 13) 

Example: The second packet of data gatnenng instruments 
contains examples of observation tools that require the 
observer to draw a map of the classroom. The data 
collected covers a wide range of classroom activities 
and, in some instances, includes noting behaviors that 
are happening all over the room simultaneously. 
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(H-ll-11) At Task - (This too! records the activity of 
every student in the class in three or four minute 
sweeps. ) 

(H-ll-12^ Verbal Flow Between Teacher and Students - 
(Through arrows and a coding system, this tool records 
the verbal interaction between the teacher and individual 
students. ) 

(H-li-13) Physical Movement - (The movement around the 
classroom by students and teachers is recorded and timed.) 

6. Trainer gives presentation on characteristics of good 
data. 

Example: The purposes for taking observation data are to 
improve instruction and promote professional growt i. It 
must be perceived by the teacher to be accurate, honest, 
and unbiased. Only then will the teacher be able to 
interpret the data and plan strategies to bring about 
improvement. Observation data, if accurately and 
objectively recorded, will meet the following criteria: 




(T-ll-4) 



CHARACTERISTICS OF GOOD DATA 

0 DEPENDABLE 

(Accurately de:.^cribes the trait or char?cter i st ic you 
intend to measure. ) 

0 RELATIVELY OBJECTIVE 

(Using professional knowledge, observer attempts to 
record as objectively as possible. The test is to 
have two people observe the same class 
independently. They should arrive at the same 
conclusions. ) 

0 REPRESENTATIVE 

(Enough information to be sure, large enough sample 
to be consistently representative.) 

0 COMMUNICATION VALUE 

(Results of data can be clearly understood and used 
by teacher . ) 
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0 REASONABLE COST 

(Data gathered and analyzed in reasonable time. Time 
is precious to both teachers and administrators. If 
the process takes up too much time, it will no doubt 
be eliminated from everyone's schedule as a matter of 
necessi ty. ) 



7. Trainer asks for clarification questions. 

8. Trainer passes out sheets of blank paper and makes sure 
everyone has a pen or pencil. 

9. Trainer asks part'c pants to think of a specific 
classroom situation and, in their teams, develop an 
observation tool to record behavior. 

Example: As a team, think of a particular classroom 
situation. If you are a teacher, envision your own 
classroom and students. Consider some aspect that merits 
observation. If you are an administrator, think of a 
classroom situation you have observed where you felt that 
the instrument you were using could be improved or 
changed to address a pai^ticular need. 

As a team, come to a consensus as to the particular 
behavior you will be observing. Keep in mind the various 
instruments that have been shared with you and develop an 
instrument that will record the behaviors your team 
wishes to examine. 

Option: Trainer has the option of using the handout on 
Classroom Situations (H-ll-14 opt). If using this 
handout, the teams design an observation instrument to 
record data on one of the situations presented in the 
handout . 



10. Trainer asks the teams to critique their classroom 

observation instrument using the following guidelines: 
(T-ll-5) 

OBSERVATION TOOL CRITIQUE 
How is the desired behavior ^easured'^ 
In what way is the observed behavior a key to classroom 
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How will behavior be recorded? 

What evidence is there that the teacher will be able to: 

0 Understand the data 
0 Interpret the resul ts 



11. Each team transfers the team*s observation tool to a 
transparency and, at the overhead projector, explains the 
tool ana its use to the large group. Modifications may 
be made in the original as suggested by the group. 

12. Trainer facilitates discussion on the uses of data 
gathering instruments and responds to questions. 



NOTES: 
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Activity 4 



NODULE II 

SUMMARY, ASSIGNMENT, AND EVALUATION 



Purpose: 



Procedure: 



1. To present main points of module 

2. To give observation assignment 

3. To a I low part icipants to evaluate module 



1. Trainer distributes Module II Summary and Assignment 
(H-l 1-15). 

2. Trainer reviews mam points of iDodule and assignment and 
answers quest ions. 

Summary: 

1. Various methods exist for collecting observation 
data. Each can provide descriptive data on 
classroom instruct ion. 

2. All observation data must be descriptive (simple 
description of what is said and done) rather than 
judgmental . 

3. Observation tools facilitate the collection of data 
and may be designed by the teacher and observer 
working collaboratively. 

4. Good observation data should meet five criteria: 

a. Dependable 

b. Objective 

c. Representat i ve 

d. Communicat ive 

e. Cost effect ive 

Assignment : 

Using an observation tool devised from the information 
given in this module, record data in the classroom of a 
fellow educator. Conduct a planning conference before 
the observation to determine the focus and develop an 
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observation tool. Discuss the results of the observation 
in a nonjudgmental feedback conference. 

3. Trainer passes out Evaluation Forms (H-ll-16) and 
collects on completion. 



NOTES: 
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(H-l 1-1) 



MODULE II OVERVIEW 
COLLECTING OBSERVATIONAL DATA 



When teachers are given specific, accurate, descriptive data on 
classroom instruction, particularly when the focus is on aspects the 
teacher selected, there is motivation to change, take risks, and 
improve classroom instruction. Therefore, to facilitate teachers' 
professional growth, classroom observation must be teacher directed, 
specific and accurate. Module II informs participants of the kinds 
of classroom behavior that can be recorded through observation, 
fami I iar izc!S them with the use of a number of common observational 
tools, and demonstrates the utility of teacher made observation 
tools. 

Ant icipated Outcomes : 

Participants wi 1 1 - 

(1) learn var ious methods of collecting 
observational data 

(2) learn how to select an appropriate 
observational tool 

(3) learn the advantages and disadvantages of 
various data collecting methods 

(4) understand the characteristics of good data 

(5) design observation tools, use them, and 
cr i t ique them 
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(H<IM) 



MODULE M AGENDA 



Act i vi ty 



Purpose 



Introduction, Agenda 
Sharing, Debriefing 



Methods of Collecting Data 



0 to introduce or reacquaint trainer 

and part icipants 
0 to review agenda items and allow 

for comments and questions 
0 to allow participants to share 

observation experience 

0 to familiarize participants with 
common data collecting methods 

0 to provide practice using 
Select ive Verbat im 



Using Observation Tools 



to provide practice in using 
observation tools 
to clarify the characteristics of 
good data 

to provide practice in designing 
and critiquing observation tools 



Summary, Assignment, and 
Evaluat ion 



0 to summarize module 
0 to assign observation 
0 to al low partic ipants 
modul e 



task 

to evaluate 
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TEACMEK: 
DATE: 
TIME: 
LESSON: 



SELECTIVE VERBATIM 
CUSSROOM OBSERVATION 



(H-II-2) 



OBSERVATION DATA: 



TIME 



DATA 



/ so 



^ 
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COMMENTS 



SELECTIVE VERBATIM (^^i^s) 
CLASSROOH OBSERVATION 



TEACHER: 
DATE: 
TINE: 
LESSON: 



OBSERVATION DATA: 



TIME 



DATA 



COMMENTS 
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CLASSKOOM OBSERVXTIOH 8EC0KD 



A WIDE LENS APPROACH 

TEACHER^ 

CLASS 

LESSON TAUGHT 



DATE AND TIME OF OBSERVATION. 

sssssssssasssassssssssssssss: 

INSTRUCTION AND ACTIVITIES: 



CLASSROOM MANAGEMENT: 



COMMENTS (TIME, MATERIALS, INTERACTION, MANNERISMS): 



Supervisor 

-^64 



ft ft ft 



191 wl III 119 


Jiiihjftrt! lessnn- 


Directions: l/s/ng ffve minute sweeps, note time and describe ttie actr/ity in the box provided. 

Atfft itnfiftnt 

Ckm Buslnfttt Managftmftnt IndMdual Group quizzftt) Tftochftr 
TImft: (roN, kmch count) (discipline) InstrucHon/lntftroctlon Inttructlon/lntftractlon Informal Evaluation Non-lntoracHvft 
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Comments: 

LiJ 
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Teacher Questionina and ResDonse Behavior 




Activity: 


Directions: wme each question asked by the teacher and fill In ttie bionics using tf>e following codes: 

Question Teacher Response 

Write verbatim or In obbrevtated form. A « Accepts 

P « Praises 

Kind PB « Probes 

K« !<rvDwledge (facts from nDemory) NR« None (no response) 

U « Utilization (using knowledge to corrpreherd, NEG « Negates 

oppty^orarxslyze) GA* Gives Answer 
C « Creative (synthesizing to arrive at a conclusion; REP ■ Repeats or rephrases tt^ answer 

nrxaklng a Judgement) 

Question Follow 

Student Response REP ■ QuestkDn repeated or rephrased 
A B Arwer RED « Question redirected 
N « No Answer 

Q= Asks for Ctarlfication ^^^^^^ l6QCh& QuestlOn 

Question Kind Response Response Foliow 
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H-II-7) 



^■Teacher:. 

Observer: 



Behavior Management 

student- 

. Date: 



Activity: 

Directiorw: l) Record time of nnlsbGhavlor. 

2) Describe each nnlsbehavlor In the box provided. 

3) Check teacher artd student responses In the box having the same number. 

4) More than on© teo'iher or student response may be checked tor a single misbehavior. 



Time 



TMCher Response Student Response 





1. 




2. 




3. 




4. 




5. 




6. 




7. 




8. 


II — 


9. 
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Ignores 






Talks back 




1. 


2. 


3. 


1. 


2. 


3. 


4. 


5. 


6. 


4. 


5. 


6. 




8. 


9. 


7. 


8. 


9. 


Vertxjl correctksn 


Continues behavior 


1. 


2. 


3. 


1. 


2. 


3. 


4. 


5. 


6. 


4. 


5. 


6. 


7. 


8. 


9. 


7. 


8. 


9. 


Nonverbal comrmmteatlon 


Stops k>ehavtor 


1. 


2. 


3. 


1. 


2. 


3. 


4. 


5. 


6. 


4. 


5. 


6. 


7. 


8. 


9. 


7. 


8. 


9. 


Questions betxsvlor 


Antagonistic 


1. 


2. 


3. 


1. 


2. 


3. 


4. 


5. 


6. 


4. 


5. 


6. 


7. 


8. 


9. 


7. 


8. 


9. 


Removes from room 


Passive 


1. 


2. 


3. 


1. 


2. 


3. 


4. 


5. 


6. 


4. 


5. 


6. 


7. 


8. 


9. 


7. 


6. 


9. 
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Teacher Behavior Tally 



Teacher: Ooserver:-,. 

Date: Subject:-^ No. of Students:. 

Lesson: 



Directions: Tally in the space at left each time you observe :he behavior indicated. 

Instructional Activity Verbal Feedback 

1 . Answered a question 13. Disapproved 

2. Asked a question 14. Encouraged 

3. Helped individual student 15. Praised 

4. Demonstrated on 16. Called student by name 

chalkboard or overhead 
5. Lectured 

6. Reviewed Body Language 

7. Tested 

S.Gave directions 17. Smiled 

1 8. Frowned 

19. Laughed 

^Managerial Activity 20. Showed Anger 

2 1 . Gestured with hands 

9. Corrected behavior 22. Moved around the room 

10. Distributed handouts 23. Sat down 

1 1 . Collected materials 

12. Handled classroom 

business 



Summary Notes: 



ERIC " 68 



Teacher:. 
Subject: _ 



Student Classroom Activities 

-Observer: 



Date:. 



No. of Students:. 



Lesson: 



Directions: Chec* those octfv.ftes lakhg place during 5 minsjte sweeps. More than one aclMty per sweep may be checked. 

nn» itstenhMiio AudtoVhuol $lud«nt 

T«sHng Pi— ntalten Pr* >ntotton Handouh T«x1book 



Urn* 



S#otwofk 



CkMt 

DItcuNlon 



Ustenlngto 
Teacher 



Learning 
Garnet 



I 



I 



Comments: 
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eccher-. 
Date: 



Classroom Discussion Observation 
Flow Chart Code 



Subject: 



No. of Students: 



Discussion Topic :- 



Student raises hand 

Teaclier calls on or communicates with student 
Student comments (not elicited by teacher) 
Teacher calls on student and gets resp>onse 
Teacher calls on student and gets r»o response 
Student raises hand, and teacher calls on student 
and receives response 



Directions: Draw enough squares below to represent student desks In ttie classroom. Symbols above are written 
inside desks during discussion. If known, names of students may be written under desk squares. 
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At Task Observation 



Teacher: 

Date/Time: 

Lesson: 

Observer:- 



1. 
2. 
3. 
4. 
5. 



Time 

10:06 
10:08 
10:11 
10:14 
10:17 



Activity 

Introduction 

Lecture 

Lecture 

Student Report 
Student Report 



Legend 

A. At Task 

B. Other Schoolwork 

C. Talking 

D. Out of Sect 



Susan 



Down 



Mel 



l.A 4.A 




l.A 4.A 


2.A 5.C 




2.A 5.C 


3.A 




3.A 


Donald 


Harry 


l.A 4.B 




Absent 


2.A 5.A 






3.B 







l.B 


4.A 


2.B 


5.D 


3.A 




Gloria 


l.C 


4.A 


2.D 


5.A 


3.C 





Karen 



Debbie 



l.A 


4.B 


2.A 


5.A 


3.B 





l.C 


4.A 


2.B 


5.A 


3.A 





Comments: 
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(H-l 1-11) 



AT TASK 



AT TASK : Used to provide data in whether individual students are 
engaged in the task or tasks that the teacher considers appropriate 
for the lesson being presented. 

The following steps must be completed to use this technique: 

1. The observer constructs a seating chart of the 
classroom, noting piaceoient of student desks or table, 

2. Students are identified on the chart by name or some 
other identifying characteristic 

3. A legend is created to identify on task behavior and 
inappropriate behavior. 

4. The observer visually scans or "sweeps" the classroom 
noting students on task, doing what the teacher 
considers app'opr iate. For example, where marking 1A 
on the student's chart means that it is the first (1) 
visual sweep and the A refers to At Task behavior. If 
the student is not on task, the observer indicates 
this by recording IB, 1C, or ID, 

5. btep 4 is repeated at regular intervals of 3 or 4 
minutes for the duration of the observation 

6. The time of each sweep should be noted with the 
classroom act ivi ty identified. 

Adapted from Acheson, Keith A. Techniques in the 
Clinical Supervison of Teachers Preservice and 
Inservice AppI icat ions . New York: Longman, 1987 




Verbal Flow Between Teacher and Students 
Key: 



low DeTwee 

I t 

J = Teacher 
D = Directive C 



= Student Q = Question P = Praise 
Directive C = Control Statment N = Neutral 
A = Antagonistic E = Encouraging 





N Q 



CCD 
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VERBAL FLOW 



VERBAL FLOW BETWEEN TEACHER AND STUDENTS : Used to record verbal 
interaction between the teacher and individual students in a 
discussion situation. 

0 Construct a seating chart noting teacher/student desks. 

0 Teacher remarks to individual students, as opposed to those 
directed to the entire class, are indicated by sral I arrows 
pointing downward and entering the desk square of the 
student addressed. At one end of the arrow is a code 
letter(s) representing the kind of remark made. 

0 Student remarks directed to the teacher are indicated by 
arrows pointing upward and originating within the desk 
square of the student speaking. They, too, have a code 
letter(s) at one end denoting the kind of remark made. 

0 A key to the code is at the top of the map and may be 

modified to reflect the interests of the teacher involved. 
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(H-ii-:3) 



Physical Movement 



Bulletin Board 



?:5D 



— Student Movement 

Teactier Movement 

O Stops 




(H-M'13) 



PHYSICAL MOVEMENT 



PHYSICAL MOVEMENT - Used to record the physical movement of both 
students and teacher as they move around the classroom during an 
observat ion per iod. 

0 Draw a detailed map of the classroom including teacher 
desk, students' desks, pencil sharpener, bookshelves, 
chalkboard - anywhere in the room a student or teacher 
might visit. Include all doors as well. 

0 Teacher movement and student .movement are recorded by 

dotted or continuous lines as noted on the observation form. 

0 At each new movement, the time is recorded near the line. 

0 Stops are indicated by circles. 

0 Names of students, if known, may be written inside each 
desk. 
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(H'l l'14-opt) 



CUSSROOM SITUATIONS 



Si tuat ion 1 . The students in a sixth grade classroom are in the 
teacher's words ''driving me crazy". Talkouts and other disruptive 
behaviors on the part of five or six students are hampering the 
learning of the entire class. The teacher is unable to speak 
without interruption, and constant inappropr iate behavior keeps 
students from classwork. 



Situation 2. Students in a large high school photography class are 
frustrated because lack of sufficient equipment creates impatient 
waiting lines to use the darkroom, the caeras, the mounting 
supplies. T»^is situation has led to vandalism and horseplay. 

Situation 3. A fourth grade teacher is attempting to use peer 
tutoring by encouraging her students to help each other with 
seatwork. She is concerned, however, that this may lead to ofi-task 
behavior and that some unpopular students might be neglected. 
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(H~l 1-15) 



MODULE M. COLLECTING OBSERVATIONAL DATA 
SUMMARY* AND ASSIGNMENT 



Summary : 

1. Various methods exist for collecting observation data. 
Each can provide descriptive data on classroom instruction. 

2. All observation data must be descrip'. ive (simple 
description of what is said and done) rather than 
judgmental . 

3. Observat ion tools faci I i tate the col lect ion of data and may 
be designed by the teacher and observer working 

col laborat I vely . 

4. Good observation data should meet five criteria: 

a. Dependable 

b. Object ive 

c. Representative 

d. Dependable 

e Cost effective 



Assignment : 

Using an observation tool devised from the information given in this 
module, record data in the classroom of a fellow educator. Conduct 
a planning conference before the observation to determine the focus 
and develop an observation tool. Discuss the results of the 
observation in a nonjudgmental feedback conference. 
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TEACHER EVALUATION FOR GROWTH 
Collecting Observational Data 
Nodule 1 1 Evaluation 



> 



LU 
> 

1 



II 1 








> 




LU 








> 




LU 








UL 






LU 






LU 


> 


LU 




LL 








LL 








LU 


O 








LU 




LU 


H- 


LL 








LL 








LU 


LU 


CO 


LU 


> 






OM 


ER 


CO 




CO 


> 


2 


3 


4 


5 



1. What overall rating of effectiveness would you 
give this module in meeting the outcomes 
ident i f ied ear I ier'? 

2. How effective were the transparencies in 12 3 4 5 
providing you with an understanding of the topic'^ 

3. How effective were the handouts in providing you 12 3 4 5 
with an understanding of this topic? 

4. How effective was the process or design used in 12 3 4 5 
this module m helping you to understand the topic'? 

5. How effect ive were the act ivit ies and information 12 3 4 5 
provided m helping you plan for a teacher 

evaluation program for growth'? 

6. How effective were the trainers in presenting the 12 3 4 5 
information and skills in this module? 



1. what activities in this training session were most effective m 
understanding the concepts presented in this module'? 



2. What specific recommendations would you make for subsequent training 
sessions of this module'? 



3. Do you have other comments? 
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DESCRIPTIVE vs JUDGMENT 



• Teacher takes five minutes to take roll; three 
changes made as students arrive late 



• Visual aids used in presentation are too small 



• Teacher's tone of voice is harsh and eyes ar^ 
unfriendly 



• Teacher handles discipline well 



• Three students express inability to read 
handwriting on board 



nonnwwi 
RMk)nal 
EducatkNvJ 
Uboratory < 



(T-II-2) 

METHODS OF DATA COLLECTION 



1 . Verbatim- written record of everything said 

2. Seiective Verbatim- seiects oniy one part of verbal 
exchange 

3. Videotapinq- coiiect novi^; vievi^ later 

4. Audiotapinq -often used in conjunction with observation to 
support a written record 

5. Wide-Anqle Notation- brief descriptive notes on classroom 
instruction and management with comments giving overall 
impressions 

6. Observing Behavior- records what is said and done; 
usually limited to specific behaviors 

Counting 

Coding 

Checking 

Rating 

Mapping 



Ragional 
Educational 
Laboratory 
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SELECTIVE VERBATIM 

• Teacher Questions 

• Student Questions 

• Positive Reinforcement 

• Student Responses 

• Control Statements 

• Habitual Remarks 

• Off Tasic Digressions 
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CHARACTERISTICS OF GOOD DATA 



Dependable 



Relatively Objective 



Representative 



Communication Value 



Reasonable Cost 



iiii till 1 1 1 MkJL. m\. 

Laboratory ^^^^^ 
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{T-II-5) 

OBSERVATION TOOL CRITIQUE 



How is the desired behavior measured? 



ERIC 



In what way is the observed behavior a key to 
ciassroom learning? 



How will behavior be recorded? 



What evidence is there that the teacher will be 
able to: 

• Understand the data 

• Interpret the results 



ilmiimiBBl mLmL. Mm. 

NOfumOTl Myf^m \ 

EduMitiontl/ \\\ 
Laboratory ^bJ^^ 



84 



MODULE Mi. THE FEEDBACK CONFERENCE 




"HOW IS IT THAT WE CAN BE SO BRUTALLY FRANK 
WITH KIDS AND HAVE SUCH DIFFICULTY FACING OUR 
EMPLOYEES WITH EVEN THE SIMPLEST PROBLEMS?" 

FREDA M. HOLLEY, INDEPENDENT SCHOOL DISTRICT, 
AUSTIN, TEXAS 
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NODULE III - OVERVIEW 
PROVIDING FEEDBACK/THE POST-CONFERENCE 



Having collected classroom data, the next step for observer and teacher 
is to analyze and interpret the results. The task is the teacher's. All 
data should be received by the teacher first. Because the information 
was recorded purely as descriptive rather than judgmental data, the data 
usually speaks for itself. Listening, sharing and asking for suggestions 
in a caring environment are valuable components of the post-conference. 
This module will present methods to analyze and interpret descriptive 
data and provide procedures for a mutally productive post-conference 
leading to meaningful goal setting. 

Ant ic ipated Outcomes : 

Part icipants wi I I - 

(1) learn how to make inferences and 
recommendations after reviewing 
observat ion data 

(2) learn the characteristics of 
constructive feedback 

(3) learn the components of a feedback 
conference 

(4) gam knowledge of the roles and 
feelings of teachers and evaluators 
in a post-conference 
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(H-lll-1) 



NODULE III AGENDA 



Activity 

Introduction. Agenda Sharing, 
Debr ief ing 



Classroom Si tuat ion 
Problem Solving 



Analyzing and Interpreting 
Data 



The Feedback Conference 



Purpose 

0 to re-acquaint 

trainers and participants 
0 to review agenda 
0 to allow participants to 

share observation experience 

0 to present classroom 

si tuat ions 
0 to identify behaviors 

for data gather ing 
0 to develop feedback based on 

observational data 

0 to present various met*^ods to 
analyze and interpret oata 

0 to provide pract ice in 
interpret ing data 

0 to inform of feedback 

conference procedures 
0 to provide practice and 

critique of the feedback 

conference 



Summary, Assignment, and 
Eva I uat ion 



0 to summar ize main 

points of module 
0 to give observation assignment 
0 to allow participants to 

evaluate module 



8f ( 



MODULE III TRAINING AGENDA 
Approximate time: 2 hours 



Act ivi ty 

1. Introduction, Agenda 
Sharing, Debriefing 

0 introduct ions i f 
appropr iate 

0 distr ibute Module 1 1 1 
Overview and Agenda 

0 review agenda 

0 answer quest ions 

0 teams meet to discuss 
observation experience 
from Module 1 1 
assignment 

0 spokesperson leports 
high I ights to large 
group 

0 record highl ights 
on chartpack 

0 faci I i tate di scussion 



Time 
20 min. 



Mater iais 

Handout : 

Module 1 1 1 Over, iew 
and Agenda 
(ri-l 1 1-1) 



2. Classroom Situation 
Problem Solving 

0 present classroom 
si tuat ions 

0 team selects a 
si tuat ion f rom I i st 

0 present tasks for 
ident i tying behaviors 
and feedback 

0 spokespersons report 
data gathering 
procedures from group 

0 trainer faci I i tates 
di scussions 



40 min. 



Handout : 

Classroom Situations 
(H-l 1 1-2) 

Transparency: 

Classroom Si tuat ion 
Tasks (T-lll-1) 
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3. Analyzing and 
Interpreting Data 

0 present lecturette on 
preparing for feedback 
conference 

0 ask for quest ions 

0 distribute lesson 
t ranscr ipt 

0 teams read transcript, 
analyze, interpret , 
and decide ways to 
improve teaching 

0 teams report to large 
group 

0 ideas wr i t ten on 
chart pack 

0 faci I i tate di scussion 



45 mm. 



Handouts : 

Keys to Data Analysis 
and Interpretat ion 
(H-ll 1-3) 

Lesson Transcr ipt 
(H-ll 1-4) 

Transparencies: 

Steps in the Feedback 

Conference 

(T-ll 1-2) 
Keys to Data Analysis 

and Interpretat ion 

(T-ll 1-3) 



4. The Feedbacic 
Conference 

0 present lecturette 
on feedback 

0 ask for two 

volunteers to role- 
play a feedback 
conference 

0 use Lesson Transcript 
and information 
gained in team 
analysis 

0 role-play takes place 

0 faci I i tate discussion 



25 mm. 



Transparencies: 

Feedback Conference 
Beliefs (T-lll-4) 

The Feedback 
Conference 
(T-ll 1-5) 
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5. Sumaryi Assignment, 
and Evaluation 



10 mm. 



Handouts: 

Summary and 
Assignment 
(H-ll 1-5) 

Evaluation Form 
(H-ll 1-6) 
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NOTE: Training equipment and supplies needed for Module III 



0 Overhead Projector 

0 Chartpack 

0 Marking Pens 

0 Paper and Pencils for Participants 



FRir 
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Activity 1 



HODULE III 
INTRODUCTION 
AGENDA SHARING AND DEBRIEFING 



Purpose: 



Prcx^ure: 



1. To re-acquaint trainers and participants 

2. To review agenda 

3. To aMow participants to share observation experiences 



1. Trainer distributes Module HI Overview and Agenda 
(H-lll-1) and reviews agenda with participants, 

2. Trainer asks for questions and concerns. 

3. Participants group in school teams, discuss observation 
experiences from Module II assignment, and select a 
spokesperson to share highlights with large group. 

4. Teams report observation highlights. Trainer records 
consents on chart pack and facilitates discussion, 

NOTES: 
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Activity 2 



f>urpo8e: 



Procedure: 



MODULE III 
CLASSROOM SITUATION PROBLEM SOLVING 

1. To present classroom situations 

2. To identify behaviors for data gathering 

3. To develop feedback based on observational data 



1. Trainer distributes handout (H-IM-2) and presents an 
overvieM^ of each of the classroom situations. 

2. Each team of training participants selects a classroom 
situation from tlie I ist. 

3. Trainer directs the teams to complete the following 
tasks. (T~lll~1) 



CLASSROOM SITUATION TASKS 

Describe the specific behaviors to be recorded that will 
provide the information requested by the teacher. 

Determine how the behaviors could be recorded; and which 
kind of observation instruments would provide objective 
data 

Decide how the feedback, based on the recorded data, 
should be presented to the teacher. 



e 



CLASSROOM SITUATIONS 
Situation 1 

Parents of a TAG (Talenied and Gifted) student have 
complained to a teacher that the students in the class 
are harrassing their child. Two or three years younger 
than the other students, yet more capable, the child 
tends to annoy his classmates with bright remarks and 
excellent grades. The teacher has no\ observed overt 
harrassment of the student but is concerned that it may 
be going on behind her back. 
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Situation 2 

An oider teacher fears his slight hearing loss may be 
affecting his teaching. He carries on lectures and 
lessons as usual but wonders if he is ignoring student 
coninents and questions because he doesn't always hear 
them. Sometimes the students appear to be laughing at 
him, and he cannot discern the treason. 

Si iuat ion 3 

Lower skilled students feel the teacher is giving 
brighter students preferential treatment in class. The 
teacher cannot see why these students feel this way 
because he feels that he treats students equally and 
fairly. The teacher would like to know if there is 
anything in his mannerisms or behavior that indicates 
di scr iminat ion. 

Si tuat ion 4 

A particular teacher of high school seniors is cited 
continuously as "my favorite teacher" by graduating 
seniors on a newspaper survey. The school administrator 
would like to know what this teacher does to merit this 
continued high recognition. 

Situation 5 

A teacher has been attempting to elicit classroom 
discussion of the literature read. However, students 
have been reluctant to respond when she calls on them, 
and no one seems to volunteer comments. Discussions 
usually end up being teacher dominated. 



4. When teams ha e completed assigned tasks a team 

spokesperson reports their discussion and data gathering 
decisions to the large group. Trainer facilitates 
discussion. 



NOTES: 
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ActivUy 3 



PurpoM: 



Procedure: 



HODULE III 
ANALYZING AND INTERPRETING DATA 

1. To present various methods to analyze and interpret data 

2. To provide practice in interpreting data 



1. Trainer presents lecturette on data analysis and 
interpretat ion. 

POSSIBLE SCRIPT (adapt as needed to fit context) 

Now that the data is collected, what is to be done with 
it? Teacher and observer must talk. Commonly called the 
"feedback conference," this step might bring to mind a 
scene of one-s^ded conversation in which one person, the 
observer, "feeds back" everything the observation data 
has revealed. Not true - the task of interpreting is a 
joint one between teacher and observer. If there is a 
leader, that should be the role of the teacher. 

Theoretically, if the data, are accurate and clear, they 
could be left in the teacher's hands to interpret and to 
use a'l his or her discretion. In fact, that should be 
the first step. But hopefully, the information is 
important and valuable enough to merit discussion. Not 
only is the intelligent input of the observer useful, but 
the sharing itself assures the teacher that what he or 
she does in the classroom is important. 

Keith Acheson and Meredith Damicn Gall outline three 
basic steps in dealing with observation data in their 
book Techniques in the Clinical Supervision of Teachers: 
(58) (T-l 11-2) 



STEPS IN THE FEEDBACK CONFERENCE 
Analyz ing 

( looking at the data to determine what it shows 
without judgmental conclusions) 
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2. Interpret ing 

(attempting to figure out why or how events occurred, 
looking at the effects of such events and considering 
opt ions) 

3. Deciding 

(what to change to improve instruction) 

There are many different ways to analyze data. Keys to 
analysis and interprexat ion can be used to make feedback 
more meaningful : (T- 1 1 1-3) (H-l 11-3) 

KEYS TO DATA ANALYSIS AND INTERPRETATION 

TREND - discover recurring patterns within a single class 
or happening across classes. 

A teacher may use a guest ioning format, a means of 
presentation, or a response behavior that forms a 
repetitive pattern and dominates the instructional 
pattern. Look for patterns across classes where the 
teacher teaches the same subject more than once during 
the day. 

Examples: 

a. One teacher directs attention and calls on students 
only in the back half of the room. Students in the 
front seats are habitually ignored unless their 
behavior cal Is attention. 

b. A teacher either repeats or paraphrases every student 
answer and follows with her own answer without 

redi rect ing the guest ion. 



• 
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C ONTENT - analyze the accuracy, difficulty, relevance, 
and relationship of the instruction to the district 
curr iculum guide I ines. 

T; is is where professional knowledge enters into the 
feedback process. If the observer is unsure of the 
relevancy of the observed instruction to the district 
program or to the skiii level of the students, the 
observer and teacher need to review the data for 
appropriateness of content. 

INTERACTION - determine the quality and vitality of the 
interaction between students, and between students and 
teacher . 
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Learning is more likely to occur in an environment that 
is non-threatening and encouraging yet stimulating. The 
verbal interaction in a classroom is a gauge for 
classroom climate. Are the exchanges primarily positive, 
exhibiting respect and kindness? Is there a balance 
between engaged interaction in the classroom and 
non-interactive opportunities for students to develop 
thei r own ski I Is? 

DISCREPANCY - find discrepancies between intended and 
actual resul ts. 

Objectives of the lesson were made clear in the planning 
conference - were they achieved'^ Following the classroom 
observation, a review by the observer and teacher of the 
Preobservat ion Planning Guide and a review of the 
recorded data will determine whether the discrepancy 
exists. 

RATIO - count behaviors and set up ratios. 

Ratio analysis is easily understood, easy to do, and used 
by most observers. Some common ratio analyses are to 
focus on individual students and set up a ratio for 
students on task to those off task; the ratio of positive 
co«m)ents to total comments; and the ratio of actual 
positive reinforcement to opportunities of possible 
positive reinforcement. The teacher and observer need to 
come to an agreement on behaviors to be recorded in the 
preobservat .on conference. 

OUTCOME - measure student achievement after instruction. 

With objectives dearly addressed, a teacher made test or 
quiz IS one way to measure the effectiveness of 
instruction. Taking pre-knowledge of the subject into 
account and allowing for basic skill deficiencies, a 
teacher can assess fairly accurately the success or 
failure of the lesson. (Assessing student outcomes is 
addressed in Module IV.) 

NULL - identify what is lacking. 

To analyze missing in'jredients. an observer needs to 
address several questions regarding a classroom 
observation experience. Do the students or teacher or 
both lack enthusiasm for the subject matter or prepared 
daily lesson? Is participation of all or at least most 
of the students apparent? Did the teacher demonstrate 
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preparation and organization'^ Was there an introduction, 
a connection to previous learning, a summary, an 
assessment, and an appropriate closure? A feedback 
conference provides the teacher and the observer the 
opportunity of answering these questions and seeking 
alternative approaches that will improve the quality of 
the classroom instruction. 

2. Trainer asks for clarification questions or comments, 

3. Trainer distributes Lesson Transcript handout on teacher, 
Jane Clark, and explains. (H-lll-4) 

Example' This is a lesson transcript, a record of 
everything that occurred in a half hour's observation of 
an eighth grade English class. Read the transcript 
carefully, and then in you. teams attempt to analyze and 
interpret the data. Next decide what you feel this 
teacher could do to improve. Select someone to record 
the team's ideas and la*er report to the large group. 

4. Trainer asks spokespersons to report and writes comments 
on chartpack. 

5. Trainer summarizes activity. 

Example: Now we have all of the objective data that Jane 
Clark and the observer agreed upon for the lesson. An 
effective feedback session is one in which the teacher, 
Jane, has an opportunity to read and evaluate the data 
before the postconf erence session with the supervisor or 
colleague. When Jane can reveal her concerns, identify 
problems, and/or select areas for growth in her classroom 
instruction, the potential for growth is more likely to 
occur. Accuracy, clarity, and objectivity are key 
characteristics of a feedback conference. 



NOTES: 
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Activity 4 



MODULE 1 1 1 



THE FEEDBACK CONFERENCE 



Purpose: 



1, To inform of feedback conference procedure 

2, To provide practice and critique of the feedback 
conference 



1. Trainer presents lecturette on feedback conference. 

POSSIBLE SCRIPT (adapt as needed to fit context) 

Before observer and teacher enter the feedback 
conference, it may be necessary for each to do a self 
check on attitude. To assist the participants in 
becoming more trustworthy and to encourage a collegial 
relationship, the teacher and observer might enter the 
conference with the following beliefs: (T-lll-4) 



0 This is a teacher with rights and feelings the 
same as mine. 

0 This teacher wants to improve and has the capacity 
to do so. 

0 The observation data were taken objectively and 
will be reviewed the same way. 

0 This meeting is not to determine the teacher's 
eligibility for contract renewal. 



0 I am a competent teacher and would like to become 
an even better teacher. 

0 The observer is an equal who is helping me to 
improve my teaching. 



Procedure: 




FEEDBACK CONFERENCE BELIEFS 



Observer - 



Teacher - 



ERIC 



if. 



0 By keeping an open mind and seeking objective 
data, I'll gain valuable information on my 
teaching. 

0 The observation data are mine to use to improve my 
teaching. 



EFFECTIVE FEEDBACK CONFERENCES 

An effective Feedback Conference will answer the following 
quest ions: (T-l 1 1-5) 

1 , WHEN"^ The feedback conference follows the classroom 
observation ls soon as possible. If too much t ime 
elapses between the two events, the *eacher often feels 
that the observation event is less important than other 
act ivi t ies . 

2. WHERE^ As with the planning conference, the meeting 
Place must be a comfort area for both participants. Some 
suggestions for the meeting place are the teacher's 
classroom, the media center, or a qu.et corner in the 
teachers' conference rooms or lounge. If the 
supervisor's office is used, it is suggested that a round 
table be used instead of the traditional setting of the 
supervisor and teacher facing one another on either side 
of the supervisor's desk. 

3 WHAT? The observer begins by presenting the data for the 
teacher to analyze. Data should be reviewed for 
objectivity and assurance that the observation data and 
instruments are those decided upon in the planning 
conference. 

4. WHY^ Together the teacher and observer interpret the 
ia ta. looking for causes, effects, and consequences. 
Af ention should be focused upon those aspects of the 
observation that, when changed, will have the potential 
for improved classroom instruction. The observer's role 
is to seek the teacher's opinions and feelings about the 
data and the classroom observation. The teacher's role 
is to determine causes, effects, and consequences of 
actions in the classroom based upon the data. Both the 
teacher and observer play an important role in the 
interpretation of the data in order to explore 
alternatives. 
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5. HOW^ Based on the observation and feedback, 
decisions can be made concerning possible changes in 
the lesson, the objectives, classroom interactions, 
etc. In the feedback conference, the teacher and 
observer discuss options for improvement based on the 
data, understanding that there is rarely one "best" 
way. The observer may compile a list of available 
resources and knowledgeable professionals, e.g., 
professional readings, audiovisual aids, available 
courses, peers who teach the same or similar courses, 
counselors, and media specialists. 

6. NOW WHAT^ At the end, the teacher and observer 
summarize the observation experience and resulting 
data with a plan for future activities . 

At the end of the conference, feedback should be viewed 
as a "sharing" rather than a "giving" experience. 

2. Trainer asks for comments or questions and facilitates 
di scussion. 

3. Trainer asks for two volunteers to role play a feedback 
conference based on the Lesson Transcript of Jane Clark s 
eighth grade class . 

Example: Let^s go back to that English teacher Jane 
Clark. What might occur in Jane's feedback conference? 
We know what happened during the observation and we have 
taken a transcript of the lesson. Based on the data, 
we've made some interpretations and suggestions. Now we 
are prepared to meet with Jane in a feedback conference. 

4. Volunteers are given a brief time to prepare for role 
play. 

5. Role play is presented. 

6. Trainer faci I i tates di scussion as indicated, focusing on 
appropriate and inappropriate behavior in the role play. 

7. Trainer summarizes Feedback Conference. 

Example: The Feedback Conference is the last step in the 
three stages of classroom observation, but it is the 
first step in goal setting. Observation data, along with 
the interpretation and decision-making that follow. 
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combined with other sources of data covered in detail in 
Module IV. become the necessary base for productive goal 
sett ing. 

NOTES: 
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Activity 5 



MODULE III 
SUMMARY, ASSIGNMENT, AND EVALUATION 

Purpose: 

1. To summarize main points of module 

2. To give observation assignment 

3. To allow participants to evaluate module 

Procedure: 

1. Trainer passes out hand-out containing summary and 
assignment . (H-l 1 1-5) 

Summary: 

1. The task of analyzing and interpreting observation 
data belongs to both teacher and observer. 

2. Obse'-^'at iop data can be interpreted by examining a 
number of different aspects which are keys to 
interpretat ion. 

3. The feedback conference is a "sharing" rather than a 
•^giving" and requires certain steps as well as 
appropriate attitudes. 

Assignment : 

Conduct a preconference. an observation of instruction, 
and a feedback conference with a fellow educator. 
Attempt to enlist a second p^^.rty to observe and record 
the class as well. Following the observation, compare 
results to validate your data. 

2. Trainer reviews main points in the summary, explains 
assignment, and responds to questions. 

3. Trainer distributes evaluation forms and collects on 
complet ion. (H-l 1 1-6) 

NOTES: 
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(H-l I 1-1) 



MODULE Ml - OVERVIEW 
PROVIDING FEEDBACK/THE POST-CONFERENCE 



Having collected classroom data, the next step for observer and teacher 
is to analyze and interpret the results. The task is the teacher's. All 
data Should be received by the teacher first. Because the information 
*as recorded purely as descriptive rather than judgmental data, the data 
usually speaks for itself. Listening, sharing and asking for suggestions 
in a caring environment L e valuable components of the post-conference. 
This module will present methods to analyze and interpret descriptive 
data and provide procedures for a mutally productive post-conference 
leading to meaningful goal setting 



A nt icipated Outcomes 

Par 1 1 CI pants will 



(1) learn how to make inferences and 
recommendat ions after reviewing 
observat lon data 

(2) learn the characteristics of 
constructive feedback 



(3) learn the components of a feedback 
conference 

(4) gam knowledge of the roles and 
feelings of teachers and evaluators 
in a post -conference 



ERIC 
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MODULE III AGENDA 



Act ivi ty 



Purpose 



Introduction, Agenda Sharing, 
Debrief ing 



Classroom Si tuat ion 
Problem Solving 



Analyzing and Interpreting 
Data 



The Feedback Conference 



0 to re-acquaint 

trainers and participants 
0 to review agenda 
0 to allow participants to 

share observation experience 

0 to present classroom 

si tuat ions 
0 to ident i fy behaviors 

for data gathering 
0 to develop feedback based on 

observational data 

0 to present various methods to 
analyze and interpret data 

0 to provide practice in 
interpret ing data 

0 to inform of feedback 
conference procedures 

0 to provide practice and 
cr it ique of the feedback 
conference 



Summary, Assignment, and 
Evaluat ion 



0 to summar ize main 

points of module 
0 to give observation assignment 
0 to allow participants to 

evaluate module 
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(H'll 1-2) 

MODULE III 
CLASSROOM SITUATIONS 



Situation 1 

Parsnts of a TAG (Talented and Gifted) student have 
complained to a teacher that the students in the class are 
harassing their child. Two or three years younger than the 
other students, yet more capable, the child tends to annoy 
his classmates with bright remarks and excellent grades. The 
teacher has not observed overt harassment of the student but 
is concerned that it may be going on behind her back. 



Si tuat ion 2 

An older teacher fears his slight hearing loss may be 
affecting his teaching. He carries on lectures and lessons 
as usual but wonders i f he is ignoring student comments and 
questions because he doesn't always hear them. He feels that 
sometimes students appear to be laughing at him. He asks for 
help in determining the reason and is asking for assistance 
in improving the situation. 

Si tuat ion 3 

Lower skilled students feel the teacher is giving brighter 
students preferential treatment in class. The teacher cannot 
see why these students feel this way because he feels that he 
treats all students equally and fairly. The teacher would 
like to know if there anything in his mannerisms or 
behavior that indicates discr imination. 



Si tuat ion 4 

A teachs3r of high school seniors is cited continuously as "my 
favorite teacher" by graduating seniors on a newspaper 
survey.' The school administrator would like to know wha* 
this teacher does to merit this continued high recognition. 



Si tuat ion 5 

A teacher has been attempting to elicit classroom discussion 
of the literature read. However, students have been reluc- 
tant to respond when she calls on them, and no one seems to 
volunteer comments. Discussions usually end up being teacher 
dominated. 
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(H-lll-3) 



KEYS TO DATA ANALYSIS AND INTERPRETATION 



TREND - discover recurring patterns within a single class or 
happening across classes. 



CONTENT - analyze the accuracy, difficulty, relevance, and 
relationship of instruction to the district curriculum 
guidel ines. 



INTERACTION - determine the quality and vitality of the 
interaction between students, and between students and 
teacher . 



DISCREPANCY - find discrepancies between intended and actual 
resul ts. 

RATIO - count behaviors and set up ratios of expected to 
unacceptable responses or behaviors. 



OUTCOME - measure student achievement after instruction. 



NULL - identify what is lacking. 
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(H-l I 1-4) 



LESSON TRANSCRIPT 



DATE 



J/ -A TIME 



SUBJECT 



TEACHER 




8:30 Jane begins class by calling roll. She marks each student 

twice. The first is on a pink roll slip and the second in her 
roll book. Students are talking; most pay no attention when 
their name is called; only 5 answer to roll. Jane visually 
determines those present, searching the ^oom after each name 
IS ral led. 

8:33 Jane walks to the 'ront of the room, attaches the roll slip to 
the clip. 

She calls out to the class, "Did everyone remember your lit 
book? Take it out and turn to page 97." Noise level increases 
as students unzip packs or reach under desks to locate books. 

Four students rise and walk to the shelf on the right side of 
the room to take books. Jane says, "If you must borrow a book 
from the shelf, please remember to return it at the end of 
class. Too many of you walk off with them." 

One boy says, "I've got six in my locker." Other students 
laugh. 

**0K, Roger, get the pass now and bring all six books to me. 
What have you done with your own book'^" 

"Mv dog ate it," Roger responds. Class laughs again. Jane 
does not smile. Roger walks to the teacher's desk, opens the 
middle drawer, grabs the hall pass, and leaves the room. 

Two students come in late. Jane changes roll slip at the door 
and walks back to her desk to change the roll book. Several 
students call out, "What page'^" Student talking continues. 

8:38 Jane Wdlks to the blackboard, repeats "Page 97" and writes it 
on the board. 

"All right, may I have it quiet?" Jane speaks and waits for 
noise to subside. Five or six students continue to talk. 
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Jane picks up the grade book, repeats "Quiet please" and 
continues "Last one to stop talking loses the points." 
Talking stops in sudden unison, except one voice. "OK, Joel, 
you were last - 5 points off daily grade." Joel groans and 
rol I s his eyes. 

8:40 Room is quiet. Jane begins lesson. "Who can tell me the four 
basic conflicts in literature'? Remember we had them on the 
board yesterday?" 

Three hands go up. Jane calls on student whose hand is not 
up. "Nancy, what are they*?" 

"Uh. let's see, um, OK. Man against Nature and..." 

"Whoops, remember what we changed the word 'man' too"? There 
are not only men in this world, but women too. So what do we 
say instead of man"?" 

"Oh. yeah, Human. " 

"Right!" 

"OK. Human against Nature (Jane writes each conflict on the 
blackboard as it is given.) Human against Human, Human against 
Society and, and. humm, uh, is it Death? I can't remember." 

"That's not a bad guess - only if it were Death. Death would 
always win in the end of every conflict." 

"Uh. uh, not if you believe in I ' f e after death." Talk-out 
from Joe. 

"Well, f jt's right. Joe, but nevertheless. Death isn't one of 
the basic conflicts. What s the one we're missing"?" 

8:42 Roger returns carrying four lit books He pretends to be 
stumbling under their weight. Class laughs. 

"OK, Roger, put them on the shelf and get to your seat." 
Roger slowly places books one by one on the shelf. Ten 
students have resumed talking. One calls out to Roger, "Good 
job. Rog." 

"All right, where were we"? We need one more conflict What 
is if?" Two hands go up. "Susan*?" Susan s hand was not up 

Before Susan can answer, Nancy calls out, "Self. Self. I 
just remembered." 

"Yeh, sure, you just found it in your notebook, cheater." Joe 
responds. 
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Jane says. "Look, things will go a whole lot better if we 
don't 1) interrupt each other, 2) speak out of turn and 3) 
call each other names Is that too much to expect?" 

8:45 '^Self is right, Nancy, but I had called on Susan. OK, we have 
read a short story for each one of these conflicts except 
one. Which one have we not had a story on?" Silence in 
room. Roger laughs. 

"OK, Roger, you tell us. The first story we read was whaf?" 
"1 don't know - oh, yeah, it was about that bird." Class 
laughs. 

"The Scarlet Ibis', righf? Now what was the conflict in that 
story?" 

"Beats me." Class laughs. 

"Anybody else know'^" Three hands go up. One of them is 
Ellen's. "El len?" 

"Man, I mean Human against Self." 

"Correct, and how about the second story 'To Build a Fire'?" 
Several students call out, "Nature'" 

"Right, and how about the story about the black boy getting 
robbed'? Human againsf? Dorothy'?" Silence. (2 seconds) 
"Andy'?" Silence. (3 seconds) "Arnold'?" 

"That was man against society because the black boy was being 
discriminated against." 

"Good. OK, thai only leaves one." 

Four students call out, "Human." 

"Exactly. This story is about one person battling another in 
a life or death struggle. Now this is kind of long so start 
reading now and plan on taking the book hooie as homework. Now 
I want it quiet and that means you as well, Roger. Whore's 
your book?" 

"I put 'email on the shelf." Class laughs. 

"Roger, will you just get a book, turn to page 97, and read'? 
Thank you." Voice is stern. Roger, grinning widely, walks to 
the book shelf and gets a book. 

8:50 After bome shuffling and whispering, students begin reading. 
Jane stands at front of room watching. Room ib quiet. 

9:00 Observer leaves room. 
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(H-l 11-5) 



MODULE III. PROVIDING FEEDBACK/THE POST-CONFERENCE 
Summary and Assignment 

Summary : 

1. The task of analyzing and interpreting observation 
data belongs to both teacher and observer. 

2. Observation data can be interpreted by examining a 
number of different aspects which are keys to 
interpretat ion. 

3 The Feedback Conference is a "sharing" rather than a 
"giving" and requires certain steps as well as 
appropriate attitudes. 



Ass ignment : 

Conduct a preconference, an observation of instruction, and a 
feedback conference with a fellow educator. Attempt to 
enhst a second party to observe and record the class as 
well Following the observation, compare results to validate 
your data. 




109 



1> 



i) 



(H-l 1 1-6) 



> 



TEACHER EVALUATION FOR GROWTH 

The Feedback Conference > hj 

Module III Evaluation 



UJ i_ UJ 
Z < QC 



1, What overall rating of effectiveness would you 1 
give this module in meeting the outcomes 
ident i f led ear I ier'^ 

2, How effective were the transparencies in 1 
providing you with an understanding of the topic'^ 

3, How effective were the handouts in providing you 1 
with an understanding of this topic? 

4, How effective was the process or design used in 1 
this module in helping you to understand the topic'? 

5, How effective were the activities and information 1 
provided in helping you plan for a teacher 
evaluation program for growth'? 

6, How effective were the trainers in presenting the 1 
information and skills in this module'? 

1, What activities in this ♦raining session were -lost effective in 
understanding the concepts presented in this module? 



LU 
> 



O LU 



^ CO 

2 3 4 



3. Do you have other comments'? 
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IX 



2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 



2. What specific recoimiendat ions would you make for subsequent training 
sessions of this module"? 



(T-III-1) 

CLASSROOM SITUATION TASKS 



• Describe the specific behaviors to be recorded 
that will provide the information requested by the 
teacher. 



• Determine how the behaviors can be recorded 
and which observation instruments would provide 
objective data. 



• Decide how the feedback, based on the recorded 
data, should be shared with the teacher. 



EdSwUonal/ W\ 
LaborMory ^^^^^ 



STEPS IN THE FEEDBACK 
CONFERENCE 



Analyzing 



Interpreting 



Deciding 



Reoijnal 
Liboratofy 
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(T-III-3) 




KEYS TO DATA ANALYSIS 
AND INTERPRETATION 



Trend- discover recurring patterns within a single class or 
happening across classes 



Content-analyze the accuracy, difficulty, relevance and 
relationship of the instruction to the district curriculum 
guidelines 



Interaction- determine the quality and vitality of the interaction 
between students, and between students and teacher 



Discrepancy -find discrepancies between intended and actual 
results 



Ratios- counl behaviors and set up ratios of expected to 
unacceptable responses or behaviors 



Outcome -measure student achievement after instruction 



Null-identify what is lacking 



RMlonal 
Educationtt 
Laboratory i 



(T-III-4) 




/ FEEDBACK CONFERENCE BELIEFS 



Observer : 

• This Is a teacher with rights and feeiings the same as 
mine 

This teacher wants to improve and has the capacity to do 
so 

• The observation data were \aken objectiveiy and wiii be 
reviewed the same v^ay 

• This meeting is not to determine the teacher's eligibility 
for contract renewal 

Teacher : 

I am a competent teacher and would like to become an 
even better teacher 

• The observer is an equal who is helping me to improve 
my teaching 

• By keeping an o^en mind ind seeking objective data, I'll 
gain valuable information on my teaching 

• The observation data are mine to use to improve my 
teaching 



ilii ,i|ii,,a«t 



Educational 
Laboratory* 
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EFFECTIVE FEEDBACK 
CONFERENCES 



When? The feedback conference follows the classroom 
observation as soon as possible. 



Where? As with the planning conference, the meeting place 
must be a comfortable area for both participants. 



Whtit? The observer begins by presenting the data for the 
teacher to analyze. 



Why? Together the teacher and observer interpret the data, 
looking for causes, effects and consequences. 



HOV/? Based on the observation and feedback, decisions can be 
made concerning possible changes in the lesson, the 
objectives, classroom interactions, etc. 



Now What? At the end, the teacher and observer summarize 
the observation experience and resulting data with a plan for 
future activities. 



NofthwMt 
Regional 
Educitionali 
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MODULE IV: USING OTHER DATA SOURCES 



"WHEN ONE PERSON HELPS ANOTHER TO SUCCEED, 
BOTH PARTIES ARE ENHANCED BY THE SUCCESS. " 

JERRY J. BELLON, UNIVERSITY OF TENNESSEE, 
KNOXVILLE, TENNESSEE 



NODULE IV OVERVIEW 



USING OTHER SOURCES OF DATA 



Though classroom observation is often used in teacher evaluation, 
other sources of evaluation data are not to be discounted, 
particularly in evaluation for professional growth where legal and 
contractual requi rements are not restrictive. Thi s modu le wi 1 1 
present other means of measuring instructional effectiveness: 
student assessment teaching artifacts, student evaluations, and 
self assessment. Through a combination of data gained by using 
these methods and classroom observation, a more definitive picture 
of a teacher's instructional skill comes together. 

Anticipated Outcomes: 

Par 1 1 CI pants will - 

(1) understand why standardized tests are not 
dependable teacher evaluation tools 

(2) recognize the value of well -constructed 
classroom assessments in teacher evaluation 

(3) learn to analyze and evaluate other 
art i facts of teaching 

(4) learn why student evaluations of teaching 
can provide teachers with valuable 
informat ion 

(5) recognize self assessment as a culminating 
activity leading to goal setting 



MODULE IV AGENDA 



Act ivi ty 



Purpose 



Introduction, Agenda Setting, 
and Debriefing 



to introduce or re-acquaint 

trainer and part ici pants 

to review agenda items and allow 

tor comments and questions 

to allow particpants to share 

observation experience from Module 



Student Assessment 



Teaching Ar t i facts as 
Evaljation Data 



Student Evaluation of Teaching 



Sel f Assessment 



Summary, Assignment. 
Evaluat ion 



0 to explain the inadequacies of 

standardized tests as measurements 

of the effectiveness of an 

individual teacher 
0 to describe the importance of 

student assessment in the 

evaluation of teaching 
0 to emphasize the need for teacher 

and supervisor training in 

assessment 

0 to define the term teachi ng 
art i facts 

0 to inform of the methodology used 
to analyze and evaluate teaching 
ar t i facts 

0 to dispel the misconceptions 
concerning student evaluations 

0 to enable participants to gather 
information from students about 
teaching 

0 to establish self assessment as 
the first step in goal setting 

0 to provide guidance in self 
assessment processes 

0 to summarize module 
0 to assign group task 
0 to al low participants to evaluate 
modu I e 



117 



MODULE IV: TRAINING AGENDA 
Approxi«aU tine: 2 hours, 5 Kinutes 



Act ivi ty 

Introduction, Agenda 
Sharing, Dabritfing 

0 introduce sel f and 
co-trainer 

0 i f appropr iate, 

part ici pants introduce 
selves 

0 distribute Module IV 
Overview and Agenda 

0 ask for questions and 
concerns about agenda 

0 teams iorm to discuss 
observation 
experiences from 
Module III 
ass ignment 

0 team spokespersons 
present observat ion 
highl ights to large 
group 

0 comments recorded on 
chartpack 

0 fac i I i tate di scussion 

0 review Teacher 
Centered Evaluation 
model 



Time 
30 min. 



Mater iais 

Handout: 

Module IV Overview and 
Agenda (H-IV-1) 

Transparency: 

Teacher Centered 
Evaluation (T-IV-1) 



2. Student Assessment 

0 teams brainstorm 

1) student character- 
istics schools measure. 

2) methods used to 
measure^ 



40 min. 



Transparencies: 

Limi tat ions of 

Standardized Tests 

(T-IV-2) 
Why Use Classroom 

Tests'? (T-IV-3) 
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3) purposes for which 
results of measurements 
are used 

0 teams report to large 
group 

0 responses written on 
chartpack 

0 discuss and summrize 

0 present lecture on 
student assessment 

0 ask for clar i f icat ion 
quest ions on lecture 

0 faci 1 1 tate di scussion 



3. Teaching Artifacts 
as Evaluation Data 

0 explain art i facts as 
evaluat ion data 

0 distribute handout on 
art i facts and discuss 



5 min. 



Handout : 

Framework for 
Analyzing Ar t i facts 
{H-IV-2) 



4. Student Evaluation 

0 introduce student 
evaluat ion 

0 teams form to list 
common teacher 
object ions to student 
evaluat ions 

0 teams report to group 

0 summar ize by 
presenting Common 
Object ions 

0 faci I i tate di scussion 



30 min. 



Transparencies: 

Can Students Evaluate 

Teachers'^ {T-IV-4) 
Common Object ions 

(T-IV-5) 
Positive Aspects of 

Student Eva'jation 

{T-IV-6) 
ImpI icat ions {T-IV-7) 
Student Evaluation 

Tactics {T-IV-8) 
Keys to Success 

lT-IV-9) 

Handout: 

Question Categories 
{H-IV-3) 
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0 teams brainstorm 
positive aspects of 
student evaluation 

0 teams report to large 
group 

0 present remainder of 
lecture and ask for 
clar i f icat ion 
quest ions 

0 teams generate I i st 
of quest ions to be 
used to evaluate 
teaching 

0 distr ibute handout on 
quest ion categor les 

0 teams report to large 
group 

0 questions written on 
chart pack under 
categor ies 

0 faci I i tate di scussion 

0 summar ize student 
evaluat ion of teaching 



10 min. Handout: 

Personal Reflection 
(H-IV-4) 

Transparencies: 

Steps in Self 
Assessment (T-IV-10) 

Sel f Assessment 
Assumptions (T-IV-11) 



5. Self Assessment 

0 present lecturette 
explaining concept of 
sel f assessment 

0 ask for clar i f icat ion 
quest ions 

0 distribute handouts 



6. Swwwry, Assignment Handouts: 

and Evaluation Module IV Summary 

and Assignment 

0 distribute Summary (H-IV-5) 
and Assignment sheet Evaluation Form 

(H-IV-6) 




0 ask for clarification 
quest ions and explain 

0 distribute evaluation 
forms and col lect on 
complet ion 



NOTE: Training supplies and equipment needed for Module 

0 Overhead Projector 

0 Chartpack 

0 Marking Pens 

0 Paper and Pencils for Participants 
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NODULE IV 
INTRODUCTION 
AGENDA SHARING AND DEBRIEFING 



Purpose: 



1. To introduce or re-acquaint trainer and participants 

2. To review agenda and allow for corments and questions 

3. To allow participants to share observation experiences 

4. To review Teacher Centered Evaluation 



Procedure: 



1 If this 



5. 



f this IS the first meeting, trainer int.'Oduces self and 
allows time for participants to introduce themselves to 
the group - name, school, position, etc. 



Trainer distributes Module IV Overview and asks for 
questions and concerns. 

If participants completed Module III. school teams form 
to discuss observation assignment experiences. A 
spokesperson is selected to report observation highlights 
to the large group. 

Teams report. Comments are written on the chartpack. 
Trainer faci I itates discussion. 

Trainer places Teacher Centered Evaluation transparency 
on overhead and reviews concept. (T-IV-1) 

Example: In Teacher Centered Evaluation with 
professional growth as the desired outcome, the teacher 
receives input from many directions. As in typical 
evaluation programs, the supervisor plays an important 
role through open communication and classroom 
observation; however, the supervisor's role is no more 
important than the other sources of input as pictured m 
thi s model . 
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Colleagues will also provide communication about teaching 
and they, too, will have collected descriptive data for 
the teacher through classroom observations. This module 
will elaborate on the ways students, through assessment 
of their work and through their evaluation of the 
teacher^s methods, can be a rich source of data. It will 
also touch on the inclusion of teaching artifacts such as 
exams and gradebooks as evaluation data as well as the 
teacher's self assessment of himself/herself in the 
classroom, a necessary step before goal setting, where 
resources will add to the whole to provide a well-rounded 
•rput system for the continuous evaluation of a teacher *s 
instruct ional ski 1 1, 



NOTES: 
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Activity 2 



NODULE IV 
STUDENT ASSESSNENT 



Purpose: 

1. To describe the importance of student assessment to the 
evaluation of teaching 

2. To explain the inadequacies of standardized tests as 
evaluations of teaching 

3. To emphasize the need for teacner training in assessment 

Procedure: 

1. Trainer asks teams to brainstorm ideas in three 
categor ies: 

1. Student characteristics schools 
measure . 

2. Methods used to measure these 
character ist ics. 

3. Purposes for which the results of such 
measurements are used. 

2. Teams meet, discuss, and record their ideas. 

3. Teams report to large group. Trainer writes ideas on 
chartpack under three categories. This will necessitate 
tearing chart .sheets from the tablet and securing them to 
the wal I or bul let in board. 

4. Trainer facilitates discussion as ideas are shared and 
then summar izes. 

Example: It becomes quite apparent that a good part of 
school time is spent in the assessment of students, 
measuring a variet: ;f characteristics through numerous 
methods for some undeniable good reasons. Several 
conclusions can be drawn: 

1. Assessment is important in schools, taking 
up a good deal of time and effort 
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2. Of the various methods to assess students, 
those most frequently used depend on 
teachers* observations and judgments, and 
their ability to construct tests. 

3. Among the uses for assessment it is clear 
that teachers can use these classroom 
measures to determine how things are going 
... whether their teaching is producing 
learning. 

(Note: Trainer may have to prompt and reword to end up 
with these points. But they are the key points. The 
trainer may have to facilitate discussion to draw out 
these ideas.) 



5. Trainer presents lecture on student assessment. 

POSSIBLE SCRIPT (adapt as needed to fit context) 

Educators, both teachers and administrators, would be 
highly insulted, and rightfully so, if they were to be 
accused of not caring if their students learned. Surely 
the primary goal of schools is to encourage, facilitate, 
and, in fact, bring about learning on the part of 
students. If this is truly the case, why then have the 
skills necessary to measure such learning been sadly 
disregarded in the teacher education curriculum? Neither 
teacher training programs nor teacher certification 
agencies have typically required any assessment 
training. Classroom teachers, as well as their 
administrators, carry on their ed';cational duties daily 
with little knowledge of the means to accurately measure 
the learning of their students. 

Certainly they try. Teachers can spend 25 to 30 percent 
of professional time involved in assessment-related 
activities. These activities often are car r ied wi thout 
the important training necessary to insure quality and 
accuracy. Supervisors, who lack expertise themselves, 
hesitate to place confidence in teacher made testing 
tools. 

One might argue that those tests accompanying or embedded 
in textbooks fill the need for quality testing. As most 
educators wi 1 1 attest, such examinations often fall short 
of expectations. Sometimes these tests are developed m 
the complete absence of quality control standards. 



ERLC 



125 



14., 



In response, when placed under pressure from the public, 
districts turn to norm referenced standardized 
achievement tests such as the Iowa Test of Basic Skills. 
California Achievement Test, and the Standard Achievement 
Test, True, these tests must meet certain standards, and 
they do provide a basis for comparison on a national 
level. However, one thing they do not do is provide 
specific information on the effectiveness of the 
classroom instruction of individual teachers. 

Administrators who use standardized achievement tests to 
evaluate teachers are failing to realize the following: 
(T-IV-2) 
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LIMITATIONS OF STANDARDIZED TESTS 
FOR PURPOSES OF TEACHER EVALUATION 

Broad, shal low content coverage 
(Standardized tests graze only the surface of a 
student's knowledge, touching on areas that may or 
may not have been stressed m the student's 
classrooms. Up to three years of content might be 
tested in 35 or 40 test items.) 

Match between test and instructional content 
(The overlap between test content coverage and the 
priorities of any particular local curriculum can be 
less than 50 percent. But what is most problematic 
is that few districts have checked the extent of 
over lap, ) 

Match between test and instructional cognitive level 
(Different test batteries test various levels of 
cognitive challenge in different ways to different 
degrees. Thus, there exists the danger that local 
curr iculum wi th respect to thinking ski I Is wi II not 
be adequately tested by the locally adopted test 
battery. Again few districts have checked the extent 
of this match, ) 

Imprecision of score scales 

(Sometimes a single wrong answer m a specific area 
can plunge or raise a student's score as much as two 
grade levels. Because so few questions attempt to 
measure so much, each question carries more weight 
than it merits, especially in the extreme high and 
low ends of the grade equivalent score scale,) 
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Unreliability of change scores 
(Educators tend to look closely at change scores 
hoping to see improvement in a child's score from 
year to year. But for reasons having to do with the 
statistical properties of these data, individual 
student pretest to posttest change scores cannot be 
counted upon to be reliable enough to warrant such 
analysis.) 

Narrow operational definition of student achievement 
(Most standardized tests measure a very narrow part 
of a student's total knowledge and skills, 
concentrating on reading, vocabulary, grammar, math, 
and other subjects that are tested only by means of 
multiple choice test items. More complex achievement 
related skills such as speaking and writing that do 
not translate into multiple choice formats— and that 
we value greatly — are not assessed ) 

Influence of outside factors on student performance 
(Scores on standardized achievement tests are 
influenced by many factors that are beyond the direct 
control of the teacher, such as educational 
environment at home and the direct influence (or lack 
thereof) of prior teachers.) 

So do we conclude from t^i$ that student achievement 
data have no role to play in teacher evaluation? We 
certainly do not! Paradoxically, one of the best 
measures of the effectiveness of teaching is how weT 
students are learning. The issue is, how do we 
measure that learning? The answer is: day to day 
classroom measures of student achievement. Here's 
why: (T-IV-3) 



WHY USE CLASSROOM PERFORMANCE TESTS ^ 

0 Students can demonstrate skills taught by the present 
teacher . 

0 Situation is real life, in an actual classroom with 
classroon. competencies. 

0 Effective diagnosis is possible. 

0 Natural classroom events can be observed. 




0 Continuous feedback on student progress occurs. 
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But one key point remains; teachers need more training in 
developing and using effective assessments. A vast 
majority of teachers received no such relevant training 
during their professional preparation. Recent trends 

indicate that such training may become more available and 

required for teacher certification. 

6, Trainer asks for clarification questions on the lecture 
and facilitates discussion. 



NOTES: 
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Activity 3 



MODULE IV 

CU^SSROOM ARTIFACTS AS EVALUATION DATA 



Purpose: 



Procedure: 



1. To define and explain the term teaching artifacts 

2 To inform of methodology used to analyze and evaluate 
icaching art i facts 



Trainer explains the use of teaching artifacts in the 
evaluation of teaching. 

Example: As part of assessment training, the analysis 
and evaluation of teaching artifacts enables teachers to 
better their instructional skills. The term teaching 
art i facts is defined by Thomas McGreal in Successful 
Teacher Evaluation as "all instructional materials 
teachers use to facilitate student learning." He 
includes lesson plans, unit planning mater iai s, tests, 
quizzes, study guides, worksheets, homework assignments, 
and any other item used in teaching. (159) 

Every teaching tool a teacher creates or selects either 
enhances student learning or detracts from it. Care and 
attention are necessary in order to provide the best 
teaching materials to complement the subject matter and 
learning styles and levels of the pupils. However 

able to analyze and evaluate the 
To help in this task, McGreal has 
the evaluation of content, design, 
teaching art i facts 



teachers seldom are 
mater iais they use. 
set up cr i ter ia for 
and presentation of 



2. Trainer distributes handout A Framework for Analyzing the 
Artifacts of Teaching (H-IV-2). 

Example: McGreal's Framework for Analyzing the Artifacts 
of Teaching speaks to all kinds of teaching materials, 
not only written forms but audiovisual presentations as 
wel I . 
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Though such handouts can only motivate teachers to beg 
to think about the effects of teaching materials, 
thorough training in the area would improve classroom 
instruction greatly. 



NOTES: 
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Activity 4 



Purpose: 



1. 



2. 



Procedure: 



NODULE IV 
STUDENT EVALUATION OF TEACHERS 



To dispel the misconceptions concerning student 
evaluat ions 

To enable participants to generate questions for students 
about teaching 



1. Trainer begins lecture on Student Evaluation of Teaching. 
SCRIPT 

Most teachers feel uncomfortable with student 
evaluations. At present, student evaluation is common 
only at the college and university level, but its value, 
even with primary grade students, is under-estimated. A 
strong rationale exists for using student evaluation at 
a'l levels. As long as specific guidelines are followed 
in writing the forms, making sure that the teaching, 
rather than the teacher is evaluated, great benefits for 
the teacher and the student can result. To provide a 
clear look at student evaluation, we will look at (1) 
Teachers* Concerns, (2) Rationale, (3) Models for Use and 
(4) ImpI ications. (T-IV-4) 

2. Trainer has group brainstorm and record reasons why 
teachers are distrustful of student evaluations of their 
teaching . 

After about 5 to 10 minutes, trainer asks teams to 
compare their list with the transparency list of Common 
Objections. Trainer continues lecture as follows: 

Teachers are distrustful of student evaluations for a 
number of reasons. (T~!V-5) 
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COMMON OBJECTIONS 
Students Immature 

(Immaturity, even among very young students, does not 
appear to affect their assessmemt of what goes on in 
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their classes. At their own level, students can 
describe honestly and accurately.) 

0 Students Untrained 

(Though students do not have vast knowledge of either 
teaching technique or subject matter, they are able 
to appraise classroom climate and environment fairly 
accurately. ) 

0 Students Inexperienced 

(Being full-time students, they may be more 
experienced than most adults out of the education 
field, and certainly their first-hand experience in 
that classroom is more than a one or two lime adult 
observer. Furthermore, their experience is fresh, 
and they commonly compare experiences with that of 
their peers who are also full-time students.) 

0 Popular i ty Contest 

(Popularity contests are won on good looks, smiling 
faces, handshakes, hugs, and favors, none of which 
seem to carry much weight when students evaluate 
teachers. ) 

0 Delayed Judgments Better 

(Sometimes it is felt students will be better judges 
of their past teachers later in life when they have 
more wisdom and perspective. Studies comparing 
teacher evaluations from adults looking back on past 
teachers and those from students presently enrolled 
in ^hose same teachers' classes are surpnsingly the 
same. ) 

0 Students Volat i le 

(Yes, at football games and rock concerts; however, 
in evaluating teaching, they appear to maintain 
classroom composure, and their evaluations seldom 
show excessive negative or positive emotion.) 



Trainer asks teams to again brainstorm, this time 
recording the positive aspects of student evaluations. 
After five to ten minutes, trainer continues the lecture 
using the transparency on Positive Effects of Student 
Evaluation of Teaching. Ask teams to compare their lists 
and ask for possib'e additions. 

(Lecture continues) 
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Not only are most of the concerns about student 
evaluations unwar rented, but the practice has a 
considerable list of merits. (T-IV-6) 



POSITIVE ASPECTS OF STUDENT EVALUATION OF TEACHING 

0 Students participate in all instruction 

(Their observation is more than the two or three 
half-hour sessions a supervisor may be able to 
afford. They're always there.) 

0 Teaching and learning a reciprocal process 
(It takes two cooperatives to make a learning 
s i tuat ion complete. ) 

0 Students partners in classroom interaction 

(Students have a vesteH interest in what goes on in 
the classroom. All of them want to feel comfortable 
and most of them want to learn something. In this 
process they become a partner because much depends on 
them. ) 

0 Student evaluators can feel more involved 

(Students feel flattered that someone cares what they 
think and feel they have some power to bring about 
change. ) 

0 Teachers listen to students 

(Teachers are trained to listen and respond to 
students. When a teacher's sel f-evaluac ion is 
contradicted by student evaluations, teachers are 
often motivated to change.) 

0 Student evaluation can promote trust 

(Students are aware the teacher is lay mg himsel f 
open to criticism. This promotes a trusting 
re'at ionship. ) 

0 Feedback can be obtained regularly at low cost 

(Students are available every day of the school year 
and willing to share their expert opinions wiinout 
pay.) 



Beyond these positive aspects are implications 
affect the entire school climate positively. 
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IMPLICATIONS 



Involving students in the assessment of teacher 
per /ormance: 

1. Establishes a greater dialogue between students 
and teachers 

2- Requires that students and teachers both take a 
clo'vjr look at what goes on in the learning 
process 

3. Increases the trust level between students and 
teachers 

4. Provides immediate feedback and gives teachers 
information about their instruction without the 
threat of formal evaluation 

5. Provides teachers with a strong and viable 
opportunity to move toward greater instruction 
excel lence 



Student evaluations need not always be a rating form. 
Other tactics can yield valuable information from 
students. (T-IV-8) 



STUDENT EVALUATION TACTICS 

0 Open discussion of a particular unit or activity 

0 Ircerview with individua.o or small groups 

0 Paper and pencil questionnaire 

0 Inferential evaluation via focused student writings 

The primary key to using student evaluation is to be sure 
all participants - the students, the teacher, the 
administrator - understand that the object of evaluation 
is teaching, not teacher. McGreal says, "Students are 
much more reliable in describing life in the classroom 
than they are in making evaluative judgments of the 
teacher /' 

Other keys to success are the following: (T-IV-9) 
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KEYS TO SUCCESS 

0 Ask the right questions 

(Questions refer to teaching practices not personal 
qualities of the teacher. Teachers should make-up 
the evaluation forms or at least be involved in their 
development . ) 

0 Make i t voluntary 

(For both student and teacher.) 

0 Eliminate all risk to the student 

(No names or other information that could give 
identity away. Often questionnaires are administered 
and collected by a third party.) 

0 Suggest action, possible change 

(Unless improvement can result, why spend time and 
effort?) 

2. Trainer asks for clarification questions or comments on 
the lecture and facilitates discussion. 

3. Trainer asks teams to generate a list of questions to be 
used in the evaluation of teaching. Questions may fall 
into such categories as course content, instructional 
processes, learning environment and other aspects of 
teaching. Handout on questions is distributed. (H-lV-3) 

4 After approximately 10 minutes, teams report their 

questions to the large group. Trainer writes them under 
cavegories listed on chartpack paper and displayed on the 
wall. Trainer facilitates discussion as questions are 
shared. 

5. Trainer summarizes. 

Example: Although student evaluations can make teachers 
uncomfortable, their value is under-estimated. 
Consistent ratings of a teacher comparing one yeai's 
evaluations to the next year's and from adult alumni -^f 
the class to current students have shown the honesty and 
accuracy students display. However, resea/ch is 
inconclusive as to whether student evaluation can improve 
teaching. Much, of course, depends upon the attitude and 
teaching goals of the teacher. 



NOTES: 
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Activity 5 



MODULE IV 



SELF EVALUATION 



Purpose: 



1. To provide guidance in self evaluation 

2, To establish self evaluation as the first step in goal 
sett ing . 



Procadure: 



POSSIBLE SCRIPT (adapt as needed to fit context) 

1. Trainer presents lecturette on Self Assessment. 

Gerald Douglas Bailey defines self assessment as the 
"process of collecting, analyzing and drawing 
conclusions about the teaching act/' From this 
definition, most teachers will realize that the practice 
is practically a given in the teaching profession. Such 
behavior is probably a daily occurrence for most 
teachers, and yet it is doubtful that most would see it 
as self assessment. In order for the activity to become 
useful in the goal setting process, teachers must delve a 
little deeper than normal procedure and perceive the act 
as more than a cursory review of a lesson or unit. 

Bailey advises teachers to concentrate on present 
behavior. He questions "any self help activity which 
depends heavily on memory." The handout called Personal 
Reflection (H-IV-4), developed by Vito Perione. does 
accent the present by requiring a close examination of 
the highs and lows of the teaching day just completed. 

Video tapes of classroom instiuction can be useful in 
self assessment. They become more valuable if the 
teacher views the tapes with a teaching peer or 
supervisor to point out aspects a teacher may fail to 
see. 

As a process leading directly to relevant productive 
goals, a set of steps may be followed. (T-IV-10) 




STEPS IN THE SELF ASSESSMENT PROCESS 



0 Identify relevant performance criteria 
(What behaviors illustrate good teaching?) 

0 Analyze self perceived skills 
(What are your strengths?) 

0 Acquire additional objective informat-on from 
students, peers, videotape critiques 
(Observation by peers and/or supervisor and student 
assessments are also useful data.) 

0 Compare outcomes from self and others 
(Closely examine all data.) 

0 Establish priorities by asking questions: 

1. What are the priorities in this 
instructional setting? 

2. How do my priorities relate to 
organizational goals? 

3. What will give me the greatest amount 
of return for time invested? 

4. How will these priori t ies improve 
learning opportunities for students'^ 

0 Prepare to write goals 

From the beginning to the end of self assessment, keep 
the following key assumptions in mind: (T-IV-11) 



SELF ASSESSMENT ASSUMPTIONS 

0 Necessary but not sufficient activity 

(By itself, self assessment is never enough to 
provide a thorough review of instructional practices.) 

0 Key to change process; motivation from within 
(It is important that the teacher is aware that 
change is possible and beneficial. In self 
assessment, more so than any other data gathering 
activity, motivation is likely to be a by-product.) 



Places teacher in a pro-active role 

(The teacher acts on self knowledge and self 

motivation, not administrative prompting.) 

Subjective process; supplement with other data 
(Because the process is a sub-ective one other data 
from objective sources must be gathered.) 

Need skill and knowledge of teaching process 
(Without a sound background in what constitutes good 
teaching, the teacher will be unable to identify 
strengths and weaknesses in his/her teaching; this, 
of course, must be a prerequisite to professional 
growth. ) 

Contributes to sense of self efficacy 
(The practice puts teachers in control, empowers them 
to seek ^^If improvement in a safe, nonjudgmental 
cl imate. ) 

Basis for professional sel' development 
(Self assessment is not on., an essential part or 
professional development, but its cornerstone. 
Professional development cannot occur without 
periodic self assessment.) 

Easier to recommend than to do 
(Looking at one's teaching skill in depth is more 
than mere appraisal, and self evaluation is never 
entirely easy or pleasant.) 



NOTES: 
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Activity 6 



MODULE IV 
SUMMARY, ASSIGNMENT, AND EVALUATION 

Purpose: 

1. To suftmarize module 

2. To assign group task 

3. To allow participants to evaluate module 

Procedure: 

1. Trainer distributes Module IV Summary and Assignment 
(H-lV-5), reviews material, and asks for clarification 
quest ions. 



Summary: 

1. Standardized tests scores have no role to play in 
teacher evaluation. 

2. Teacher made assessment tools are the most valid 
instruments to measure student learning when the 
teacher has been trained in assessment practices and 
when the results are used to promote professional 
development . 

3. Assessment training in teacher education and 
inservice is essent iai . 

4. Teaching artifacts may be used as data in teacher 
evaluat ion. 

5. Student evaluation of teaching is a useful source of 
data at all levels of instruction. 

6. Self assessment of teaching is another source of data 
and the first step in meaningful goal setting. 



Assignment : 

If you are a teacher, design a student evaluation form to 
cover a unit of instruction recently given in your 
classroom. Keep in mind that questions should cover 
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methodology and technique rather than personal 
characteristics, in other words teaching, not the 
teacher. Examine the data and with a teaching peer, 
interpret the data. 

Second, complete the activities on the Personal 
Reflection handout as a first step in self assessment 
(H-IV-4), 

If you are a supervisor, do the same assignment modifying 
it to question teachers in your school about your 
performance as an administrator. 

2. Trainer distributes Evaluation Form (H-IV-6) and collects 
on complet ion. 

NOTES: 
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(H-IV-1) 



MODULE IV OVERVIEW 
USING OTHER SOURCES OF DATA 



Thouqh clossroom observation is often used in teacher evaluation, 
other sources of evaluation data are not to be discounted, 
particularly in evaluation for professional growth where legal and 
contractual requi rements are not restrictive. This module wi M 
present other means of measuring instructional effectiveness 
student assessment, teaching artifacts, student evaluations and 
self assessment. Through a combinaMon of data gained by using 
these methods and classroom observation, a more definitive picture 
of a teacher's instructional skill comes together. 

Anticipated Outcomes: 

Part icipants wi 1 1 - 

(1) understand why standardized tests are not 
dependable teacher evaluation tools 

(2) recognize the value of well-constructed 
classroom assessments in teacher evaluation 

(3) learn to analyze and evaluate other 
art i facts of teaching 

(4) learn why student evaluations of teaching 
can provide teachers with valuable 
informat ion 

(5) recognize sel* assessment as a culminating 
activity leading to goal setting 
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MODULE IV AGENDA 



Act i vi ty 



Purpose 



Introduction, Agenda Setting, 
and Debr ief ing 



to introduce or re-acquaint 

trainer and participants 

to review agenda items and allow 

for comments and questions 

to allow particpants to share 

observation experience from Module 

III 



Student Assessment 



Teaching Art i facts as 
Evaluat ion Data 



to explain the inadequacies of 

standardized tests as measurements 

of the effectiveness of an 

individual teacher 

to describe the importance of 

student assessment in the 

evaluation of teaching 

to emphasize the need for teacher 

and supervisor training in 

assessment 

to define the term teaching 
ur t i facts 

to inform of the methodology used 
to analyze and evaluate teaching 
art i facts 



Student Evaluation of Teaching 



Sel f Assessment 



Summary, Assignment, 
Evaluat ion 



0 to dispel the misconceptions 
concerning student evaluations 

0 to enable participants to gather 
information from students about 
teaching 

0 to establish self assessment as 
the first step in goal setting 

0 to provide guidance in self 
assessment processes 

0 to summarize module 
0 to assign group task 
0 to allow participants to evaluate 
module 
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(H-IV-2) 



A FRAMEWORK FOR ANALYZING 
THE ARTIFACTS OF TtXHING 



Content 

Quality of artifacts can be considered from the point of view ot content 
or essential meaning. Some considerations related to quality of content 
are: 

1. Validity. Is the artifact materially accurate and 
author i tat i ve'^ 

2. Appropriateness. Is the content appropriate to the level 
of the intended learner"? 

3. Relevance. Is the content relevant to the purpose of the 
lesson"? 

4. Motivation. Does the artifact stimulate interest to learn 
more about the subject^ Does it encourage ideas for using 
the mater lal"? 

5. Application. Does the artifact serve as a model for 
applying learning outside the instructional situation? 

6. Clarity. Is the content free of words, expressions, and 
graphics that would limit its under standab i li ty"? 

7. Conciseness. Is the artifact free of superfluous 
material? Does it stick to the poinf? 



Pes i gn 

Design of artifacts should proceed from an analysis of the content of the 
lesson or instructional unit. High quality artifacts conform to 
instructional objectives. The quality of an artifact is the product of 
its design characteristics, its relevance to instructional objectives, 
and its application to content. 

1. Medium Selection. Is the most appropriate medium used for 
meeting each objective and presenting each item of content 
(e. g. films, textbook, teacher -prepared handout)? 

2. Meaningfulness. Does the artifact clearly support learning 
objectives? If so, is this apparent to the learner? 



Ih i 

143 



3. Appropr iateneos. Is the design appropriate to the needs 
and skill levels of the intended learner'? Are time 
constraints considered in the artifact's design'? 

4. Sequencing. Is the artifact sequenced logically? Is it 
employed at the appropriate point in the presentation'? 

5. Instructional Strategies. Is the artifact format 
appropriate to the teaching approach'? Does its 
construction incorporate sound learning principles'? 

6. Engagement. Does the artifact actively engage the 
learner'? Does it reinforce the content with appropriate 
practice and f2edback questions'? 

7. Evaluation. Is there a plan for evaluating the 
effectiveness of the artifact when used by the intended 
learner'? Can the success rate for the artifact be easily 
determi ned*? 



Presentat ion 

Presentation considerations include physical and aesthetic aspects of 
artifact as well as direc.ons for its use. 



1. Effective Use of Time. Is the artifact suitable for the 
time allotted'? Is learner time wasted by wordiness or 
extraneous information unrelated to learning objectives'? 

2. Pace. Is the pace appropriate to the level of the 
learners, neither too fast nor lOO slow'? Does the pace 
vary inversely with difficulty of contenf? 

3. Aids to Understanding. Are directions dearly explained'? 
Are unfamiliar terms defined'? Are important concepts 
emphasized'? 

4. Visual Quality. Do the visuals show all educationally 
significant details? Is composition u.ic I uttered'? Does the 
composition help the learner recognize important contenf? 
Are essential details identified through appropriate use of 
highlighting, color, tone, contrasts, position, motion, or 
other devices'? Is the type size legible from the 
anticipated maximum viewing distance'? 

5. Audio Quality. Can the audio component be clearly heard*? 
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Physical Quality. Is the artifact durable, attractive, and 

simple? Are size and shape convenient for hands-on use and 
storage'^ 

From Thomas L. McGreal, Succcessful Teacher 

Evaluation. Alexandria, VA: ASCO. 1983. 
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ASK STUDENTS QUESTIONS PERTAINING TO: 



1 . Course Content 

0 Clarity of objectives or expectations 

0 Difficulty of material 

0 Organization of content 

0 Perceived relevance or usefulness 

0 
0 
0 
0 

2. Instructional Processes 

0 Pace 

0 Clarity 

0 Amount of work required 

0 Fairness of assessments 

0 
0 
0 
0 

3. Learning Environment 

0 Clarity of behavioral standards 

0 Quality of interactions 

0 Mot i vat ion to study 

0 Feelings of control over rewards 

0 
0 
0 
0 

Other Relevant Topics 

0 Teacher Characteristics 

0 
0 
0 
0 



146 



PERSONAL A^FLECTION 



(H-.IV-4) 



Act ivi ty 1 : 

Think about the teaching day just completed. 

Take ten minutes to jot down everything you recall about that teaching 
day. 

Now consider the following questions: 
What did you do alone'? 

What did you do with a ^ew chi Idren, with large groups of 
children, with other teachers'? 

Where did you stand/sit most of the time'? 

What did you do a little of that you would like to do more of? 
What prevented >ou from doing that'? 

What did you do a lot of that you would like to have done 
less of? 

Which of the things you noted reflect a rr-^jor goal in 
your teaching'? 

Act ivi ty 2: 

Using a scale of 1-10 (worst possible = 1 to best possible = 10), what 
was the morning like'? What was the afternoon like'? 

What contributed to the way you evaluated the day? List the factors and 
rank them according to importance. 

At the end of the work, analyze the factors listed. What ones occurred 
repeatedly'? What changes (select two or three manageable ones) could you 
make to bring you. day closer to a 10 on the scale'? 

Act i vi ty 3" 

During the last month, what experience or instructional task caused you 
particular difficulty'? What skills did you lack to conduct that 
act ivi ty'^ What knowledge or skills would have helped'? 

From Vito Per rone, "Supporting Teacher 
Growth." Chi Idhood Education , April/May 
1978 
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MODULE IV SUFMARY AND ASSIGNMENT 



Sumnary : 

1. Standardized tests scores have no role to play in teacher evaluation. 

2. Teacher made assessment tools are the most valid instruments to 
measure student learning when the teacher has been trained in 
as^^essment practices and when the results are used to promote 
professional development. 

3. Assessment training in teacher education and inservice is essential. 

4. Teaching artifacts may be used as data m teacher evaluation. 

5 Student evaluation of teaching is a useful source of data at all 
levels of inst ruct ion. 

6. Self assessment of teaching is another source of data and the first 
step in meaningful goal setting. 



Assignment : 

If you are a teacher, design a student evaluation form to cover a unit of 
instruction recently given in your classroom. Keep in mind that 
questions should cover methodology and technique rather than personal 
characteristics, in other words teaching, not the teacher. Examine the 
data and with a teaching peer interprei: the data. 

Secondly, complete the activities on the Personal Reflection handout as a 
fir3t step in self-assessment. If you are a supervisor, do the same 
assignment, modifying it to question teachers in your school about your 
performance as an administrator. 



148 



(H-IV-6) 



> 

TEACHER EVALUATION FOR GROWTH ^ 5 



LU 
> 



Using Other Data Sources uj ^ t. «J 



Module IV Evaluation 



1. What overall rating of effectiveness would you 
give this module in meeting the outcomes 
ident i f ied ear I ler? 

2. How effective were the transparencies in 
providing you with an understanding of the topic'^ 

3. How effective were the handouts in providing you 
with an understanding of this topic? 

4. How effective was the process or design used in 
this module m helping you to understand the topic"^ 

5. How effective were the activities and information 
provided m helping you plan for a teacher 
evaluation program for growth'^ 

6. How effective were the trainers in presenting the 
information and skills in this module"^ 



LU 



< 5 < 

> i = i ^ 



(X 
LU 
> 



Z CO 

12 3 4 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 



1 What activities ir this training session were most effective 
understanding the concepts presented in this module^ 



2. What specific recotiwendat ions would you make for subsequent training 
sessions of this module'^ 



3 Do you have other com^nents? 
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(T-IV-1) 



EACHER-CENTERED EVALUATION 



Growth 



Resources 




Colleagues Students 



Nocttiwett #V^r \ 

EduMtioMi/ W\ 
Uboratory ^^^Ai^ 
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(T-JV-2) 

-imitations of Standardized Tests 
for Purposes of 
Teacher Evaluation 



• Broad, shallow content coverage 

• Match between test and instructional content 

• Match between test and instructional cognitive 
level 

• Imprecision of score scales 

• Unreliability of change scores 

• Narrow operational definition of student 
achievement 

• Influence of outside factors on student 
performance 



EduSitioMi/ W\ 
Laboratory ^M^^^ 
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WHY USE CLASSROOM 
PERFORMANCE TESTS? 



• students can demonstrate skills taught by the 
present teacher 



• Situation is real-life, in an actual classroom 
with classroom competencies 



• Effective diagnosis is possible 



• Natural classroom events can be observed 



• Continuous feedback on student progress 
occurs 



EducttkKiat 
Uboratory i 
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(T- IV-'4) 



CAN STUDENTS EVALUATE 
TEACHERS? 



EducatioMi 
Laboratory 



ERIC 



• Teachers' Concerns 



Rationale 



Models for Use 



Implications 
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COMMON OBJECTIONS 



• students Immature 

• Students Untrained 

• Students Inexperienced 

• Popularity Contest 

• Delayed Judgments Better 

• Students Volatile 





POSITIVE ASPECTS OF STUDENT 
EVALUATION OF TEACHING 



• students participate in all instruction 

• Teaching and learning a reciprocal process 

• Students partners in classroom interaction 

• Student evaluators can feel more involved 

• Teachers listen to students 

• Student evaluation can promote trust 

• Feedback can be obtained regularly at low 



cost 



nonnwwi 

EduorSonal 
laboratory ^ 
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(T-IV-7) 




IMPLICATIONS 



Involving students in the assessment of teacher 
performance 

1. Establishes a greater dialogue between students and 
teachers 



2. Requires that students and teachers both take a closer 
look at what goes on in the learning process 



3. Increases the trust level between students and teachers 



4. Provides immediate feedback and gives teachers 

information about their instruction without the threat of 
formal evaluation 



5. Provides teachers with a strong and viable opportunity to 
move toward greater instruction excellence 



Rtgional 
Educational 
Laboratory 
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r 



STUDENT EVALUATION 
TACTICS 



• Open discussion of a particular unit or activity 

• Interview with individuals or small groups 

• Paper and pencil questionnaire 

• Inferential evaluation via focused student 
writings 
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KEYS TO SUCCESS 



Ask the right questions 
Make it voluntary 
Eliminate all risk to the student 



Suggest action, possible change 



'A 

Laboratory ^^J^^ 



158 




STEPS IN THE 
SELF ASSESSMENT PROGRAM 



• Identify relevant performance criteria 

• Analyze self-perceived skills 

• Acquire additional objective information from 
students, peers, videotape critiques 

• Compare outcomes from self and others 

• Establish priorities by asking questions 

• Prepare to write goals 



NofthwMt 

EduMtionil 
LibOfitory < 
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(T-IV-11) 




SELF ASSESSMENT ASSUMPTIONS 



Necessary but not sufficient activity 

Key to change process; motivation from within 

Places teacher in a pro-active role 

Subjective process; supplement with other data 

Need skill and knowledge of teaching process 

Contributes to sense of self-efficacy 

Basis for professional self-development 

Easier to recommend than to do 



nuf uiwNi 
Rtgional 
Educattomrt 
Laboratory^ 
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NODULE V: GOAL SETTING AND NEXT STEPS 



"TEACHERS COME TO US WITH A PROVISIONAL 
CERTIFICATE, AND THUS ARE REQUIRED TO GROW. 

CAN AND MUST HELP THEM IN THAT GROWTH 
THROUGH PERFORNATKE EVALUATION." 

WIUIAM J. GEFHART, PRIVATE ED. CONSULTANT 
ROBERT B. ENGLE, UNIVERSITY OF WISCONSIN 



NODULE V OVERVIEW 
GOAL SEHING AND NEXT STEPS 



Integral to effective evaluation is the goal setting process. Goal 
setting occurs only when reliable data have been collected, 
analyzed, and interpreted. Only then can meaningful, achievable 
goals be set. This mcdu'e gives participants criteria for 
productive goals and present ideas for motivating and providing 
resources for teachers. It also helps participants to begin the 
process of implementing a growth oriented evaluation program in 
their own school. Participants are encouraged to break with 
tradition and begin to thmk creatively about their particular 
school or district and its needs. 

Anticipated Outcomes. 

Participants wi 1 1 - 

(1) learn the purpose of goal setting 

(2) invest igate mot i vat ion theory and its 
application to teachers 

(3) learn the steps in setting personal, meaningful 
goal s 

(4) explore methods of implementing a growth 
oriented teacher evaluation program 
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MODULE V AGENDA 



Act i vi ty 



Purpose 



Introduction, Agenda Sharing, 
and Debr ief ing 



Teacher Mot i vat ion 



Writing Meaningful Goals 



Implementing Growth Oriented 
Teacher Evaluation 



0 
0 



o 



to introduce or 

re-acquaint trainer and 

part icipants 

to review agenda 

to al low part icipants 

to share observation experience 

to describe Irie dilemma of the 
mid-career teacher 
to review worker motivation 
theor ies 

to identify the conditions that 
promote professional development 

to present the steps in goal 
sett ing 

to give criteria foi productive 
goals and provide examples 

to brainstorm ideas for 
implementat ion 

to identify barriers and consider 
means of removal 



Summary and Evaluation 



0 
0 
0 



to summarize main points 

to summarize training as a whole 

to allow participants to evaluate 

module 
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NODULE V: TRAINING AGENDA 
Approximate time: 2 hours 



Act i vi ty 



Time 



Materials 



1. Introduction I Agenda 
Sharing, and Debriefing 



30 min. 



Handout: 

Module V Overview and 
Agenda (H-V-1) 



0 introduce sel f and 
co-trainer 

0 part ici pants int roduce 
selves i f appropr iaie 

0 distr ibute Module V 
Overview and Agenda 

0 review agenda 

0 ask for questions 

0 teams form to discuss 
Module IV assignment 
on Personal Reflection 

0 team spokespersons 
selected 

0 spokespersons report 
task highl ights to 
large group 

0 comments recorded on 
char tpack 

2. Teacher Motivation 30 mm. Handout: 



0 present lecturette 
on di lemma of mid- 
career teachers 



Mr . Smi th - A Teacher 
Prof i le (H-V-2) 



Transparencies: 



0 participant teams are 
given prof i le on 
Mr. Smith 



Teacher *s Di lemma 
(T-V-1) 



Ext r ins ic and Int r i nsic 
Motivation (T-V-2) 



0 ask teams to list 
ways to mot i vate 
Mr, Smith 



Strategies for Teacher 
Motivation (T-V-3) 



0 teams report 
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0 wr i te comments on 
chartpack 

0 present lecturette on 
motivation theory 

0 ask for clar i f icat ion 
quest ions 



3. Writing Meaningful Goals 

0 present lecturette 
on sett ing goal s 

0 di St r ibute Goal 
Categor ies 

0 teams consider 

teacher activities to 
prepare for goal 
sett ing 

0 teams report to 
large group 

0 ideas recorded on 
chartpack 

0 present steps in 
personal goal setting 

0 complete goal sett ing 
act i vi ty 

0 discuss personal goal 
sett ing 



25 min, 



Handouts: 

Goal Catf^qories (H-V-3) 
Speci f ic /roject ar^d 
Product Or iented 
Activities (H-V-4) 
Goal Setting Steps 
(H^V-5) 

Transparencies: 

Goal Criteria (T-y-4) 
Steps in Goal Sett ing 

(T-V-5y 



0 summarize goal setting 



Inplefsenting Growth 25 mm, 

Evaluation Planning 

evaiuaiion Worksheet (H-V-6) 

distr ibute Goal 

Planning worksheet Transparency: 

Team Goal Planning 

teams complete (T-V-6) 
worksheet 




0 



teams report to 
large group 



0 



faci I i tate discussion 



S. 



Sunmary and 
Evaluation 



10 min. 



Handouts : 

Summary (H-V-7) 
Evaluation Form {H-V-8) 



0 distribute Summary 

0 ask for comments and 
quest ions 

0 summar ize training 

0 dist r tbute Evaluat ion 
Forms and col lect 
on complet ion 

NOTE: Training supplies and equipment needed for Module V: 



0 Overhead Projector 

0 Chart pack 

0 Marking Pens 

0 Paper and Pencils for Participants 
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Activity 1 



NODULE V 
INTRODUCTION 
AGENDA SHARING AND DEBRIEFING 

Purpose: 

1. To introduce or re-acquaint trainers and participants 

2. To review agenda items and allow for comments and 
quest ions 

3. To allow participants to share personal evaluation 
exper iences 

Procedure: 

1. If this is the first meeting, tramer introduces self and 
co-trainer and asks participants to introduce selves, 

2. Trainer distributes Module V Overview and Agenda (H-V-1) 
and reviews agenda. Agenda may be printed on chartpack. 
Trainer asks for clarification questions. 

3. Teams meet to discuss data collection experiences from 
Module IV activity assignments. 

4. Team spokespersons report highlights to large group. 
Trainer records on chartpack and facilitates discussion 
as appropr iate. 



NOTES: 
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Activity 2 



Purpose: 



Procedure: 



MODULE V 
TEACHER MOTIVATION 



1. To describe the dilemma of the mid-career teacher 

2. To review worker motivation theories 

3. To identify the conditions that proirote professional 
development 



1. Trainer presents lecturette on dilemma of mid-career 
teachers using The Teacher's Dilemma. 



POSSIBLE SCRIPT (adapt as needed to fit context) 

Most teachers are deemed to be competent professionals. 
Their annual evaluations state in writing that the 
teacher meets the standards of performance required by 
school district policies and procedures. There is an 
annual activity where teachers perform the evaluation 
ritual of a district In research, terchers typically 
reported that little growth resulted fr-^.m the evaluation 
experience and, in many instances, the evaluation became 
a pro forma activity. However, these same teachers 
report that they are seeking ways to improve their 
teaching. Some talk about improving their questioning 
patterns, student interactions, teaching strategies^ or 
improving relationships with other staff members. They 
ci te a myr lad of act iv i t les that fal I u. 'er the 
professional umbrella of being an educator. If even the 
outstanding teachers are capable of growth, the question 
arises as to why so few teactiots experience professional 
growth and development. Perhaps "The Teacher's Dilemma" 
can provide us with some answers. 

(Trainer places (T-V~1) on overhead.) 



ERLC 
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THE TEACHER'S DILEMMA 



0 Lack of Recogni t ion 

0 Stagnancy 

0 Monotony 

0 Lack of Di rect ion 

0 Lack of Opportunity to Grow 

0 Time Constraints 

0 Lack of Administrative Support 

from Paul V. Biedeson, 1983 "Organizational 
Incentives and Secondary Sc.iool Teaching". 
Journal of Research and Development m Education , 
Summer, 1983. 



Many teachers, even the best and most devoted, often fmd 
themselves staring at a blank wall afte- ten or twelve 
years of teaching. There are no new pictures to see, no 
windows through which to view the rest of the world, and 
most difficult of all, there seems to be no staircase to 
climb for promotion or recognition. Even teachers who 
haven't been in the profession for a long time may fall 
into the throes of apathy unless they know that there is 
support from colleagues and supervisors and resources 
allocated for their professional growth and development. 

It's not that they have given up on teaching; they can't 
imagine doing anything else for a living. It's more that 
they feel teaching has given up on them, offering no new 
challenges, few rewards or recognition, and little 
di rect ion. 

Certainly this is not true for all teachers. Some 
individuals are able to reach out and grasp the support 
they need through community groups, professional 
associations, and personal endeavors. Unfortunately, 
this reaching out sometimes leads them away from teaching. 

Trainer distributes Mr. Smith ~ A Teacher Prof i le (H-V-2) 
and directs participants to read the handout and m teams 
generate some ideas for revitalizing Mr. Smith. 

Example: Meet Mr. Smith, a math teacher at Yawning High 
School. He does not seek professional growth. Mr. Smith 
is seeking survival . Not that far from retirement, there 
are days when he wonders if that day will ever come. 
Read this story and brainstorm ideas to motivate this 
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teacher. How would a good administrator provide support 
and help for Mr. Smith'^ 

4. Teams discuss and one member records ideas to report to 
the large group. 

5. Teams report; trainer writes ideas on chartpack and 
faci I i tates discussion. 

6. Trainer presents lecturette on mot i vat ional theories. 

POSSIBLE SCRIPT (adapt as needed to fit context) 

Theories of motivation have been around for some time» 
surely since the first employer sought to get more and 
better vork from an employee. Motivating factors fall 
into two categories: Extr insic , applied by an outside 
force, and Intr insic , coming from within. 

(Trainer displays T-V-2) 



Social Rejection 



School systems must investigate every way possible to 
bring about the motivation of the teaching staff which, 
for the most part, means providing ways for teachers to 
grow professionally by improving their effectiveness in 
the classroom. Most, if not all, of the motivators on 
the intrinsic side of the chart involve development of 
skill to the level where one can ^eel competent, 
valuable, and capable of growth. 

What can move a teacher, like Mr. Smith, off the survival 
track and on to one of professi^ .al growth'? The answer. 




EXTRINSIC AND INTRINSIC MOTIVATION 



Ext r insic 



Intr insic 



Money 

Fr inge Benef i ts 
Praise 
Recogn i t ion 
Promot ion 
Cr i t icism 
Responsibi I i ty 
Social Acceptance 



Helping Others 
Ski I I 
Know I edge 
Autonomy 
Sel f-Respect 
Achievement 

Use and Development of Talent 
Goal Setting 



ERIC 



169 

In 




of course, is not a simple one. As a great national 
teacher shortage looms ahead, researchers hav^ come up 
with a number of suggestions, some requiring no budgetary 
increases (T-V-3) . 



STRATEGIES FOR TEACHER MOTIVATION 

0 Increasing administrators' respect and support 
for teachers 

0 Reducing class sizes 

0 Providing additional support services in the 
classroom, such as teacher aides 

0 Reducing classroom disruptions 

0 Limiting severely the amount of paperwork required 

0 Redesigning the workplace physically to encourage 
interaction among teachers and reduce isolation 

0 Fostering team teaching and other cooperative efforts 
in order to reduce isolation and increase 
intel lectual chal lenges 

0 Formally providing new teachers with special support 
and guidance from experienced teachers 

0 Involving teachers in the development of school goals 
and performance expectations 

0 Encouraging interchange between teachers and other 
community professionals 

0 Honoring outstanding teachers 

Adapted from Improving the Attractiveness of the K~12 
Teaching Profession in California . California Round 
Table on Educational Opportunity, March, 1983. 

And so an answer, at least the beginning of an answer, 
becomes apparent. How can school systems motivate 
teachers'? Two important ideas emerge: (1) Attention in 
the form of honest concern, rrspect and support; and (2) 
open communication with supervisors and other teachers, 
especially concerning teaching - both major ingredients 
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in a teacher-centered evaluation program. Given such an 
environment, teachers will be motivated to set goals that 
will bring about professional growth and personal 
sat isfact ion. 



NOTES: 
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Activity 3 



NODULE V 
WRITING MEANINGFUL GOALS 



1. To give criteria for productive goals 

2. To present the steps in goal setting 

3. To provide practice in writing personal and team 
professional development goals 



1. Trainer presents lecturette on goal setting. 

POSSIBLE SCRIPT (adapt as needed to fit context) 

Goal setting, contrary to popular practice in most 
educational settings, falls last in our schedule of 
events. Educational goals are really not much different 
from those set in athletic events where the goal is "an 
area or object toward which piay is directed in order to 
score." To translate, into teaching language, the "area 
or object" becomes "instructional objective," "play" 
becomes "work or methodology," and "to score" becomes "to 
teach successfully." And, again, even in athletics, the 
game is played after the coach has held numerous 
practices, observed the players closely, and planned 
strategies. The results are the same when the goal is 
achieved - satisfaction, self-esteem, and motivation to 
cont inue. 

Goals are developed only aftfci much data gathering, 
thought, and even soul searching. This awareness stage, 
happening long before the actual goal setting, is longer 
and more taxing than writing the goals themselves. A 
serious, close look at one's self is not an easy task. 
One will need to look at faults as well as strengths and 
determine ways to develop the positives and remove the 
negatives. It cannct be done alone. Feedback from 
supportive observers is essential. This need not be 
school personnel alone, but might include friends and 
family. Activities could range from interviewing 
students, to keeping a daily journal, or to spending a 
week at the beach in quiet contemplation. 
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Trainer asks teams to consider the pre-goal setting 
stage. What might a teacher be doing over a period of 
time to prepare to set goals for professional developmenf? 

Example: Awareness of self and situation is extremely 
important to understand before setting goals. Assume 
teachers had nine months to prepare to set their goals. 
What activities can you suggest to enable teachers to see 
themselves clearly and understand their position in the 
school envi ronment ful ly'^ 

Teams brainstorm ideas to share with the group. 

Spokespersons report to large group. Comments are 
recorded on chartpack. 

Trainer presents goal criteria. 

Example: When the homework is done, the goals are drawn 
up by teacher and supervisor. Productive goals meet the 
following criteria: (T-V-4) 

GOAL CRITERIA 

1. Sped f c - clear , simple, easy to understand, 
stated in exact terms. 

2. C hallenging, vet Reachable - often teachers set 
goals they've already met, defeating t^ie entire 
purpose. 

3. Dead I ine - every goal needs a date set for 
completion; perhaps it will need to be changed 
later, but a definite date adds challenge. 

4. Supervisorv/Tresencfc - in the form of positive 
support and feedback along the way; threats and 
int imidat ion stifle growth. 

5. Perceived as Fair and Reasonable - true for both 
teacher and supervisor: if goals are perceived 
as exploitive on either side, they will be 
rejected. 

6. Resources Provided - in many possible forms - 
money, equiD^^&nt, time, help, freedom, etc. 
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Goals will fail when (1) workers (teachers) feel they are 
unable to reach the goal because they need more 
confidence and expertise or (2) they see no personal 
benefit, either intrinsic or extrinsic. 

*Adapted from "Goal Setting - A Motivational Technique 
That Works," Organizational Dyr^amics by Gary P, Latham 
and Edwin A, Locke. 

Thomas L. McGreal sees educational goals falling into 
three categories: Program Goals, Learner Goals, and 
Teaching Goals, Teaching Goals, because they refer 
directly to the activities of the teacher, are most 
useful, but goals can develop into dynamic, original 
projects such as those listed by Allen and Peinert m the 
article "Evaluate Teaching, Not Teachers." 

(Trainer distributes Goal Categories (H-V-3) and Specific 
Product-Oriented Activities (H-V-4), 



Trainer presents steps in writing personal goals (T-V-5) 
and distributes goal setting worksheets (H-V-5), 

Successful goal setting is an integral ingredient in 
planning a successful professional growth plan. The 
following specific stops provide a guide for teachers to 
follow in planning their program. 



STEPS IN GOAL SETTING 

1 . Become Aware of Sel f 

Much data has been collected, not only through 
classroom observation, but other means such as 
self-assessment, student assessment, student 
achievement, and classroom artifacts. All of this 
information presents a picture of the teacher's 
current teaching practices, but more than this, 
teachers must examine their own feelings and desires, 
look closely at their own psyches. 

2. Become Aware of Context 

The context is the total school environment including 
facilities, student population, policies, contractual 
stipulations, community attitude, and all other 
aspects having a direct or indirect influence on the 
teaching situation. 
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3 . Becofne Aware of New Developmen ts 

Research into effective teaching practices i? a 
constant. New methods, materials, equipment and 
information appear each day. An awareness of such 
gives a teacher new ideas to apply. 

4. Imagine A 1 1 Possibi I i t ies 

Allow the imagination to fly. Disregarding all 
barriers, what would be the ideal'? Is a sabbatical 
in England the answer or a week m the curriculum 
library'? First, imagine solutions, no matter how 
impractical they may seem. 

5. Attach to Real i ty 

Now after a flight of fancy, confront reality. What 
realistically can and cannot be done considering 
resources. Don't allow negative thinking to remove 
any idea without consulting administrators. 
Possibilities may exist of which you are unaware. 

6. Write the Goal 

Much has been said about the importance of writing 
measurable goals. Allan A. G I at thorn in 
Differentiated Supervision states "a simple proposal 
is best." Attempts to make a goal quantifiable and 
measurable could destroy the idea behind it. Many 
worthwhile endeavors cannot be measured in black and 
whi te numer ical terms. 

7. Seek Resources 

What will be needed in the way of products and people 
to accomplish the goal? Who and what can help? 



Participants complete goal setting activity on developing 
personal goals. 

Trainer reviews steps and leads discussion on goal 
sett ing. 

Trainer summar izes goal setting. 
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Example: Teachers' goals, administrators' goals, all 
work together and become part of the "common vision" of a 
school or district. Firm commitment on each individual's 
part produces an effective school in which students learn 
and teachers and administrators grow. 



NOTES: 
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MODULE: V 
IMPLEMENTING GROWTH ORIENTED 
TEACHER EVALUATION 

Purpose: 

1. To develop team professional goals 

2. To brainstorm ideas for implementation 

3. To identify barriers and consider means of removal 

Procedure: 

1. Trainer introduces group task. 

Example: Each team has a different school environment, 
different concerns and different strengths. As teams, 
look closely at your own situation and de'cermine the ways 
that teacher evaluation can enhance the potential for 
professional growth and development. 

Returning to the basic ideas of collegiahty and common 
vision, discuss in your teams how you would involve your 
fellow educators in this program you have begun to 
bui Id. 

The handout now being distributed has three columns - one 
for professional growth goals for your new program, one 
for the barriers you will most certainly confront, and 
one for the methods to remove those barriers. (H-V-6) and 
(T-V-6) Spend some time in serious exploration. This 
worksheet can become the first draft of a plan of action. 

Be ready to share your progress with the large group. 

2. After approximately 10-15 minutes, trainer asks teams to 
share implementation ideas. 

3. Teams report. Trainer faci I i tates discussion. 



NOTES: 




NODULE V 
SUMNARY AND EVALUATION 



To summarize main points of module 

To summarize training 

To allow participants to evaluate module 



1. Trainer di str ibutes Summary handout , reviews, and 
asks for comments. (H-V-7) 

SIM/IARY 

1. Teachers, particularly those in mid-career , often 
lose the motivation to grow professionally 
because they perceive that the educational 
environment is not providing the attention and 
concern that is needed to support their 
professional development, 

2. Teachers respond best to intr insic motivators 
which give them the means and opportunity to 
improve their instructional skills. 

3. Goal setting, from awareness of self and 
situation to locating resources to fulfill goals, 
takes time and careful thought on the part of 
both teacher and supervisor. 

4. Productive goals meet certain criteria and will 
fail if teachers feel they cannot reach them 
because of lack of skills, confidence, or little 
personal benefit if the goals are reached. 

5. Implementing growth oriented teacher evaluation 
develops collegia I relationships between the 
supervisors and teachers and establishes a common 
vision of good educational practices, 

2. Trainer summarizes training. 

Example: We've ewe to the end of this training 
series, but as you can see. it's really the beginning 



178 Is/ 



for you. Now the effort is yours to return to your 
schools and rebuild. With the help of your colleagues, 
new and improved teacher evaluation program can be 
constructed, one that has the potential of changing the 
entire school environment by motivating teachers to 
continue t.ieir professional development. This growth 
will have a posi t ive effect upon their students and 
fel ^ow educators. 

Beginning with a common vision of good teaching, moving 
through a planning conference based on trust and 
commitment, to careful and accurate classroom 
observations, and concluding with constructive feedback 
and meaningful goals, th'S training is a framework in 
which to place your own vision. Your task has just 
begun. 

3. Trainer distributes evaluation forms and collects on 
completion. (H-V-8) 



NOTES: 
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MODULE V OVERVIEW 
GOAL SETTING AND NEXT STEPS 



Integra! to effect ive evaluat ion is the goal setting process. Goal 
setting occurs only when reliable data have been collected, 
analyzed, and interpreted. Only then can meaningful, achievable 
goals be set. This module gives participants criteria for 
productive goals and present ideas for motivating and providing 
resources for teachers. It also helps participants to begin the 
process of implementing a growth oriented evaluation program in 
their own school. Participants are encouraged to break with 
tradition and begin to think creatively about their particular 
school or district and its needs. 

Anticipated Outcomes: 

Participants wi 1 1 - 

(1) learn the purpose of goal setting 

(2) investigate motivation theory and its 
application to teachers 

(3) learn the steps in setting personal, meaningful 
goals 

(4) explore methods of implementing a growth 
oriented teacher evaluation program 
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NODULE V AGENDA 



Act ivi ty 

Introduction, Agenda Sharing, 
and Debr ief ing 



Teacher Motivation 



Writing Meaningful Goals 



Implementing Growth Oriented 
Teacher Evaluation 



Sumrrary and Evaluation 



Pu rpose 

0 to introduce or 

re-acquaint trainer and 

part icipants 
0 to review agenda 
0 to al low part icipants 

to share observation experience 

0 to describe the dilemma of the 

mid-career teacher 
0 to review worker motivation 

theor ies 

0 to identify the conditions that 
promote professional development 

0 to present the steps in goal 
set t ing 

0 to give criteria for productive 
goals and provide examples 

0 to brainstorm ideas for 

implementat ion 
0 to identify barriers and consider 

means of removal 

0 to summarize main points 
0 to summarize training as a whole 
0 to allow participants to evaluate 
modu le 
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MR. SMITH - A TEACHER PROFILE 



Mr. Smith has taught math at Yawning High School for 15 years and is 
a competent teacher. Mr Smith's classes are well disciplined. No 
one ever complains, neither student nor parent. 

The same class procedure is followed every period, every day: oral 
correction of homework, new assignment on the board and a cursory 
•'Any questions'?" The rest of the period - two-thirds of i t at least 
- is seatwork, quiet seatwork. Mr. Smith often leaves class at this 
time and goes to the faculty smokmg room or reads the daily 
newspaper in the media center. Sometimes he stands m the hall and 
watches the office aides pick up roll slips. 

Once, about 5 years ago. an administrator asked Mr. Smith why he was 
out of class so much. Mr Smith explained that if he were to stay 
in the room, the students would lean on him too heavily for help. 
He felt it was best for the students to learn to work problems by 
themselves, as their first tendency was to ask for help at any sign 
of trouble. The administrator accepted .us explanation, especially 
when Mr. Smith pointed out that neither vandalism nor unruly 
behavior ever occurred in his absence as proven by the immaculate 
condi t ion of the room. 

Once Mr. Smith asked tne administrator why General Math and Remedial 
Math classes, infamous for slow and unmotivated students, always 
filled his teaching schedule when Geometry. Algebra, and Calculus 
with brighter, better students always went to other math teachers. 
Mr. Smith was told he was the only teacher who could "handle those 
kids." 

Contrary to what his teaching fellows believe. Mr. Smith is a highly 
intelligent person with an excellent college record (a Master's 
Degree in higher math). He is also slim, clean, and well dressed. 
He is friendly to most people but not a social izer in the faculty 
room after school. Students appear to respect him. He jokes around 
with them now and then, but aiso has a reputation for immediate and 
harsh discipl ine. 

The administration has noted that Mr. Smith often leaves school 
before 4 p.m., especially on warm days. 
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MAJOR CATEGORIES FOR QOAL SETTING 



1 . Program Goals 

0 To review and make appropriate changes in a seventh grade 
Unguage arts program; 

0 To introduce the new reading series to the second grade; 

0 To revise the contemporary American writer's unit for my 
fourth-period advanced literature class; 

0 To review the thematic units used in my fifth-grade social 
studies program; 

0 To improve articulation between science programs m fourth 
and f i f th grades; 

2. Learner Goals 

0 At least 80 percent of the students will be able to correctly 
identify at least 80 percent of the problems on a long 
division test. 

0 The students will be able to demonstrate their ability to 
write a descriptive essay. 

0 The students will show an increased appreciation for the 
American free enterprise system. 

0 My fifth-grade class will be able to identify the Presidents 
of the United States by October 15. 

0 At least 70 percent of my students will be reading at grade 
level by February 15. 

3. Teaching Goa' s 

0 Increase use of instructional objectives in developing 
classroom teaching strategies. 

0 Deve'op procedures for increasing the amount and quality of 
student-teacher verbal interaction. 

0 Increase the number of extended student-teacher contacts and 
student ideas in lecture and discussion settings 

0 Increase my level of enthusiasm by the use of more overt 
physical actions (voice, gesture, facial expression, 
movement ) . 
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Tailor my questioning style to the different ability levels 
in my classroom. 

From Tnomas L. McGreal. "Helping Teachers Set Goals". 
Educational Leadership , February, 1980: 416-418. 
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SPECIFIC PROJECT AND PRODUCT-ORIENTED ACTIVITIES 

Planning and directing an inservice workshop for area teachers 
in a specific subject field. 

A business teacher developing a student secretary program. 

Developing pre and post unit mathematics skills tests for use of 
mastery learning techniques correlated to textbooks and course 
of study. 

Publishing articles about school system special progranns. 

Developing an alternative comprehensive observation/evaluation 
format appropriate for guidance counselors and library 
special i sts. 

Guiding parent evaluation of a guidance plan designed to 
increase student/parent interaction. 

Designing student evaluation forms that conespond more closely 
to specific subject matter. 

Organizing individual learnir^g packets into self teaching 
chenii St ry un i ts . 

Developing a workbook for drug and alcohol awareness for use by 
all district elementary teachers. 

Charting student behavior with recommendations for changing 
teaching procedures. 

Reviewing computer software and developing a resource book for 
school system teachers correlated with course of study. 

Forming a volunteer parent program for diagnosing and defining 
kindergarten students' developmental skills. 

P^'eparing a resource booklet on the State of Ohio for the course 
of study. 

Implementing a plan using volunteers to teach computer awareness 
and keyboarding at the elementary level. 

Developing an alternative spelling program for gifted students. 

Administering parent evaluations of teacher-parent conferences 
witn recommendations for their improvement. 




Developing and distributing a brochure on tips for 
homework, study habits, and facts about our school. 

Organizing lunch hour group guidance sessions dealing wi 
heal thy eat ing habi ts. 

Organizing National Honor Society students into a peer 
tutoring contingent for use in study hall periods. 

From Dennis L. Allen and William F. Peinert, "Evaluate 
Teaching, Not Teachers," Updating School Board Policies , 
June, 1987: 5. 
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STEPS IN GOAL SETTING 
PERSONAL GROWTH AND DEVELOPMENT 

1. Become Aware of Self (self assessment, feelings) 

2. Become Aware of Context (school environment) 

3. Become Aware of New Developments (effective teaching 
pract ices) 

4. Imagine Al I Possibi I ities (ul t Imate dream) 

5. Attach to Reality (consider available resources) 

6. Write the Goal (develop for personal growth) 

7. Seek Resources (who and what can help) 
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TEAM GOAL PLANNING 



PROFESSIONAL 
GROWTH GOALS 



BARRIERS TO 
ACH I EVEMENT 



METHODS TO 
REMOVE 
BARR I ERS 
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MODULE V. GOAL SETTING AND NEXT STEPS 
SUMMARY AND EVALUATION 



Sumary: 

Teachers, particularly those in mid-career, often lose the 
motivation to grow professionally because they perceive that the 
educational environment is not providing the attention and 
concern that is needed to support their professional development. 



Teachers respond best to intrinsic motivators which give them 
the means and opportunity to improve their instructional skills. 

Goal setting, from awareness of self and situation to locating 
resources to fulfill goals, takes time and careful thought on 
the part of both teacher and supervisor. 

Productive goals meet certain criteria and wUI fail if workers 
feel they cannot reach them because of lack of skills or 
confidence; or they perceive no personel benefit if they do 
reach them. 

Implementing growth oriented teacher evaluation will take 
collegial relat io'-.ships between administrators and staff and a 
common vision of good educational practices. 
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TEACHER EVALUATION FOR GROWTH (H~V~8) 



Goal Setting and Next Steps > uj 

Module V Evaluation = ^ ^ 

LU ^ U- 

U- ^ UJ 

UJ |_ UJ 



> 



^ 5 ^ ^ ^ 

^ ^ ^ ^ ^ 

^ I § I ^ 

What overall rating of effectiveness would you 12 3 4 5 
give this module in meeting the outcofnes 
ident i f ied ear I ie*''? 



2 3 4 5 
2 3 4 5 
2 3 4 5 



2. How effective were the transparencies in 1 
providing you with an understanding of the topic'? 

3. How eff -ctive were the handouts in providing you 1 
with an understanding of this topic? 

4. How effective was the process or design used in 1 
this module m helping you to understand the topic'? 

5. How effective were the act ivi ties and information 12 3 4 5 
provided hi helping you plan for a teacher 

evaluation program for growth'? 

6. How effective were the trainers in presenting the 12 3 4 5 
information and skills in this module? 



1. What activities in this training session were most effective in 
understanding the concepts presented in this module'? 



2. What specific recommendations would you make for subsequent training 
sessions of this module'? 



3. Do you have other comments? 
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THE TEACHER'S DILEMMA 



• Lack of recognition 

• Stagnancy 

• l\/lonotony 

• Lack of direction 

• Lack of opportunity to grow 

• Time constraints 

• Lack of administrative support 



from Paul V. Bredeson and others, "Organizational 
Incentives and Secondary School," Jourpal of Research and 
Development in Education . Summer, 1983. 
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EXTRINSIC AND INTRINSIC 
MOTIVATION 



Extrinsic 
Money 

Fringe Benefits 
Praise 
Recognition 
Promotion 
Criticism 
Responsibility 
Social Acceptance 
Social Rejection 



Intrinsic 

Helping Others 
Skill 

Knowledge 
Autonomy 
Self-Respect 
Achievement 
Use and 

Development 

of Talent 
Goal Setting 



RMlonal 
Educational 
Laboratory 
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STRATEGIES FOR 
TEACHER MOTIVATION 



• Increasing administrators' respect and support for teachers 
Reducing class sizes 

Providing additional support services in tlie classroom, 
such as teacher aides 

Reducing classroom disruptions 

Limiting severely the amount of paperwork required 

• Redesigning the workplace physically to encourage 
Interaction among teachers and reduce isolation 

Fostering team teaching and other cooperative efforts in 
order to reduce isolation and increase Intellectual 
challenges 

Formally providing new teachers with special support and 
guidance from experienced teachers 

Involving teachers In the development of school goals and 
performance expectations 

Encouraging interchange between teachers and other 
community professionals 

Honoring outstanding teachers 



Adapted from improving the Attractiveness of the K-1 2 Teaching 
Profession In California. California State Department of Education, 
1983 ^ 
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GOAL CRITERIA 



1. Specific 

2. Challenging, Yet Reachable 

3. Deadline 

4. Supervisory Presence 

5. Perceived as Fair and Reasonable 

6. Resources provided 

Adapted from Gary P. Latham and Edwin A. Locke, "Goal 
Setting~A Motivational Technique that Works," 
Organizational Dynamics. Autumn 1979 
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STEPS IN GOAL SETTING 



Become aware of self 



Become aware of context 



Become aware of new developments 



Imagine all possibilities 



Attach to reality 



Seek resources 



ill! ■til I !■ ■! mLmL. m\. 

rSSSSi /\a\ 
Educatiorwl/ W \ 
Laboratory ^^kJ^ 
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TEAM GOAL PLANNING 



Professional 
Growth Goals 



Laboratory ^^b^^ 



Barriers to 

Achlgygmgnt 



Metliods \o 
Remove Barriers 
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Teacher Evaluation: 
Accountability and Growth 
Systems — ^Different Purposes 



What arc ihe rcquircmcnis and ihe diffcicnccs between an ac- 
couniabiliiy system and a growth-onented system of teacher 
evaluation? The author explores the answers to this basic ques- 
tion in an effort to show which one is likely to have more impact 
on the quality of teaching 



p 



By Richard J. Stigclns 



VI YOL'RSELF in this teacher's 
place 



■/ m fxaluated e\cry two or three 
years and this is the \ear' I've been 
teachtnf; 25 \ears. so i kno^ thf rou- 
tine But still, it always makes me a little 
ner\ous The principal and I taikfd 
about It and did ^ome planning \^£ 
agreed on f^round rule!^, talked about 
objecttxes rexte^ed lesson plans, 
planned for the classroom obsen atton 
etc Vif 'vf worked together for years 
The principal kno^s I'm a f^ood 
teacher U'/i\ be nenou^ ' 

"The da\ and the hour of the obser- 
vation armed So principal I started 
the j/ioK Twent\ minutes into it the 
principal armed took a fevi notes, and 



Rkth^ro J Stiogis^ is direcior. Center for 
Performance Assessment. Northv^esi Re- 
gional Educational Laborato*^ Ponland. 
Oreg 



departed 30 minutes later Did the prin- 
cipal kno\^ I ran into trouble and had to 
change plans midstream"* Vi/i\ did tht 
kids choose that time to beha\e as the\ 
did'* Did the principal realize that e\ en 
da\ IS not like this"* M\ mind is r^-^ng' 
' 7 received my answers to these and 
other questions at m\ post -obse nation 
conference W'« ^ere to meet after 
school that same da\, but because the 
principal nas dela\ed at the district of- 
fice, we met a couple of weeks later Tht 
feedback ^as all very positne The state 
specifies the criteria There are no rah 
mils as such, ji^'t comments All the 
comments nere very flattennn (as the\ 
alwa\s are) I received my usual satis- 
facton overall rating, signed the form 
and left it's al^a\s the same — / never 
understand / get nenous'" 

Whot Was Accomplished? 

Ma\be no! a typical evaluation sce- 
nano. but it exemplifies a majontv of 
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(hem — what v^as accomphshed that >Aav 
of value to the teacher, lo ihc student, lo 
the school, administrator, or taxpayers'^ 

The onU accomplishment uas that 
the terms of the state teacher evaluation 
lau (requinng evaluation) and (he col- 
lective bargaining agreement (spcci- 
fving evaluation procedures) were sat- 
isfied Beyond this, the only noticeable 
outcome was that the teacher's anxiet) 
was raised bnefls then reduced for two 
or three more years 

But what cKe could have been ac- 
complished"^ Wh\ were additional posi- 
tive outcome^ not achieved'' Wh>. for 
instance, did the teacher not receive 
feedback that would promote pro- 
fessional growth Possible answers to 
these questions are explored here 

Purposts of Evoluotion 

Teacher evaluation systems t>picallv 
claim to serve two purposes 

• To provide information for use in 
personnel management decisions 
such as htr ng. firing, promotion, 
terure. and. most reccnllv. salary or 
merit In this context, evaluations 
promote educational accounir^thn 

• To promote the professional dexel- 
opment of teachers Ostensiblv. 
evaluations provide information on 
teachers' strengths and weaknesses, 
so remedial (raining can be planned 
Some define the first as summative 

teacher evaluation and the second as 
formative (Millman. 1981 ). others, such 
as school administrators, often refer to 
formative evaluation as supervision and 
summative as evaluation 

Whatever tne labels, evidence sug- 
gests that most teacher evaluation sys- 
tems serve only (he accountability 
(summative evaluation) function and 
have little or no impact on teacher or 



school involvement (Stiggins and 
Bridgeford. 1985) Sharp differences 
between these (wo purposes appear to 
make it difficult for (he same evaluation 
system to serve both Let s explore why 
(his might be (he case 

First, a definition of what I mean bv 
each type of evaluation system Ac- 
countability systems are generally 
defined by s(ate law and/or collective 
bargaining agreements between teachers 
and school distncts to include a pre- 
observation conference between teacher 
and supervisor followed by classroom 
observations by the supervisor. The par- 
ticipants then meet again to review and 
discuss the results A wntten record of 
the evaluation is often placed on file 



Because accountabi7ify 
evafuation is subject to public 
(possibly iudidai) review, the 
data required to demor\strote 
mir\imum competence must be 
venfiab/y objective and 
standardized for all teachers 
and evaluators. 



These steps are earned out e\cr\ year 
or two or three (o provide evidence of 
teacher competence If (he principal 
finds a problem, wntten evaluation rec- 
ords become evidence of a need for 
some personnel action If there ajie no 
problems, the results are placed on file 
and no funher action is taken 

Evaluadons intended to promote pro- 
fessional growth are rare Therefore, my 
descnption defines more of an ideal than 
a reality Growth-oncnted evaluations 
tell teachers what aspects of their (cach- 
ing performance are highly developed 
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and u hat nccdb funhcr development In- 
formaiion on the qualit> of performance 
ma> come from the supervisor, peers. 
studeniN. or the teacher's own self- 
analvsib 

Feedback ma\ be continuous or 
inicrmiitent ii is the teachers' job to (ai 
evaluate the feedback and (b) take re- 
sponsibilit> for acting on that feedback 
More about this later However, for this 
svstem to work, supervisors must sup- 
port the teacher's self-improvement 
etforis uith staff development re- 
sources 

Thiv distinction should make clear 
thai both kinds of evaluation are impor- 
tant Each can be useful, if done well, 
but ue should not pursue one to the 
exclusion ot the other We need a bal- 
ance District polic) statements on 
teacher evaluation often recognize the 
imponance oC thai balance, but actuil 
evaluation practice is often out of bal- 
ance 

In effect, most districts ask one 
evaluation system to serve two pur- 
poses In m> opinion, this cannot work 
Accountabilit) needs ma) be served 
tnionunatelv. however, teachers' im- 
provement needs are not In fact, one 
couid argue that teachers' grouth has 
been suppressed through a fear of tr\inc 
anything neu. especiallv if expectations 
and the cost of not improving aren't well 
defined 

To understand u hv . let's explore dif- 
ferences between accountabilit> and 
gr. uth-onented evaluation systems in 

• The purposes of the systems — 
decisions to be made and the interests 
served by evaluation. 

• Impact — the number of teachers af- 
fected and the imponance of the deci- 
sions. 

• Evaluation mechanisms available for 



use in each — data required, data 
sources, and keys lo success, and. 
• The potential limitations and kev 
beneHts of each system. 

Difftrtncts in Furposts 

First, the two systems have different 
'^««iposes Evaluation systems that serve 
summative or accountabilit) purposes 
have as their purpose the elimination of 
incompetent keachers. Teachers who fail 
10 meet minimum standards of com- 
petence are required to improve under 
threat of personnel action. Thus, the ac- 
countability system has the interests of 
the district and the communitv at hean 

Once minimum competence is dem- 
onstrated and the teacher is ceniTied 
and/or granted tenure, the evaluation 
system no longer affects that teacher 
That IS. teachers are not required by lau 
or contract to move beyond minimum 
competence, nor docs an accountabilitv 
evaluation system provide an) external 
motivation to do so 

On the other hand, evaluation svs- 
tems that serve professional develop- 
ment purpjses have a fundamental Iv 
different purpose They are designed to 
promote excellence by helping the 
alread) competent teacher attain neu 
levels of professional excellence Thus. 
It has the interests of the professional 
teacher at hean. 

Impoct of Evoiuotion 

As a result of these different pur- 
poses, the two systems have a different 
impact on overall school quality -and in- 
dividual teachers 

Accountabilit) systems stnve to af- 
fect school quality by protecting :ru- 
denis from incompetent teachers How- 
ever, because nearly all teachers are at 
least minimally competent, the accouni- 
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abilit) system directi> affects onl> a 
ver> feu teachers uho are not com- 
petent 

Thus, if our goal is lo improve gen- 
eral school quality— and we use onlv 
ihose strategies that affect a fes^ 
teachers— overall school improvement 
IS likely 10 be a ver> slow process 

Grouth-oriented systems, on the 
other hand, have the potential of affect- 
ing all teachers — not just those feu uho 
are having problems There is no ques- 
tion that all teachers can improve some 
dimension(s) of their performance 

The problem in this case, houever. is 
that evaluation s> stems purposelv de- 
signed to trigger such growth through- 
out the teacher ranks are at least rare, if 
not nonexistent This is uhy such sys- 
tems offer the promise of great impact 
on school improvement But that prom- 
ise IS yet to be realized 

Nou let's turn to the issue of impact 
on the individual teacher If evaluation 
IS to improve schools, it must motivate 
individual teachers to become better 
teachers 

The two systems differ in their man- 
agement of this motivation issue Ac- 
countabilit) systems relv on (a> the re- 
quirement of law and contractual 
obligation to compel teachers to par- 
ticipate, and (b) the threat of personnel 
action to trigger growth when needed 

The effect of required panicipation is 
clear If teachers are not doing the job. 
thev must change or leave the pro- 
fession If the) are doing the job. there 
IS no impact, was shoun in the open- 
ing scenario 

But a growth-onented system must 
manage the motivation issue differentl) 
and therefore, its impact on the indi- 
vidual vanes Since it is neither legal 
nor feasible to require all teachers to 



demonstrate skills above the level of 
minimum competence participation in 
growth systems cannot be required for 
competent teachers 

Teachers cannot be obliged to •"attain 
excellence. " houever loftv such a goal 
might seem, because there is no univer- 
sallv acceptable definition of excellent 
performance While standards of min 
mum competence can be defined and 
applied uniforml) to a!l. the standards 
of defining excellence varv marked!) 
from context to context and teacher to 
teacher <Duke. 1985) 

For instance, excellent teaching could 
be defined in radicalK different ua>s in 
an inner citv versus suburban hieh 
school, in a kindergarten versus a junior 
high, or in music versuis science The 
pursuit of excellence is a private, pro- 
fessional matter best managed and con- 
trolled b) each individual teacher 

This docs not make it a less important 
goal Nor docs it erase the community 's 
responsibility to provide teachers the 
support thev need to achieve pro- 
fessional improvement But what it dixs 
sav IS that motivation to participate in 
grouih-oriented systems must come 
from within each teacher For all teach- 
ers who can find that inner motivation, 
there is the promise of positive impact 

Evaluation Mtchonisms 

Because accountabilit) evaluation is 
subject to public (possibl) judicial) re- 
view . the data required to demonstrate 
minimum competence must be venfi- 
abl) objective and standardized for all 
teachers and evaluators In shon. the 
data and the process by which the> are 
collected must be legally defensible 

Typicallv . the most legally defensible 
type of data for such an evaluation are 
those based on direct observation— 
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classroom performance— usuall> con- 
ducted b\ ihc teacher's supervisor All 
accountabilit) evaluation mechanisms 
arc designed to protect the due process 
nghts of the teacher and the school dis- 
inct Therefore, they are ngidlv mle- 
governed processes that are carefull> 
negotiated and managed 

Gro\fcth systems are not constrained 
in this wav. Foi example, in growth 
s\stems— unlike accountabilitv s>s- 
lems — the performance cniena can be 
individualized, and the nature and 
sources of performance evaluation data 
can be much broader than those used in 
accountability systems 



/n order fo grow, o teacher 
m\j%^ see end ocknow/edge 
fhe need for cSonge. 



We have alread\ said that the pursuit 
v>f excellence is an indi\idual matter 
That means the direction and pace of 
that growth must be defined in ways that 
are relevant to the individual teacher 
The direction and pace are defined in 
terms of the performance goals or cn- 
iena toward which the teacher sinves 

Growth systems place decisions about 
what ihose criteria should be in ihe 
hands of the teacher Teachers are more 
likelv 10 consider and act upon feedback 
ihat describes iheir classroom perfor- 
mance without judgment and in terms 
thev understand and accept 

Therefore, the key lo successful 
growth evaluation is reliance on perfor- 
mance cntena endorsed as appropnaie 
by each individual teacher 

Manv data sources not permitted in 
accountability systems are viable op- 
tions for growth systems For instance. 



a teacher's self^assessmeni would be 
considered self-serving and therefore 
inadmissible in a termination heanng 
Yet the teacher's own perspective on 
growth needs is invaluable to pro- 
fessional development !n order to 
grow, a teacher must see and acknowl- 
edge the need for change 

Peer assessment would certainlv be 
challenged by the school distnct in an 
adversarial battle with the teacher's as- 
sociation over termination of one of its 
members. In a legal sense, it would be 
considered poientiall) biased Yet, we 
know there mav be no more qualified 
source of feedback on teacher perfor- 
mance than another expenenced. com- 
petent teacher. Teachers take their col- 
leagues' reviews to hean and learn from 
them 

Similarlv. student evaluations of 
teacher performance v^ould be suspeci 
in a termination hearing Participants 
could regard students as easih in- 
fluenced, biased, or unqualified tojuu^. 
minimum competence But there mas 
be no more valid source of inforTnaiion 
on and cniicism of learning environ- 
ments than the students who live and 
work in those environments When their 
views are sought in a careful, thoughtful 
wav. students can provide insights no 
one else can Every teacher who is sen- 
ous about professional growth is deepl> 
interested m how he or she affects stu- 
dents and IS perceived by them 

Finally, data on standardized student 
achievement test performance are not 
regarded by experts as appropnaie evi- 
dence in summative teacher evaluation 
because student standardized test per- 
formance is influenced bv so manv fac- 
tors beyond the control of the teacher 
Yet we know that one index of teacher 
effectiveness is student learning 
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If vvc arc careful lo give ihe leacher 
ihe lools 10 irack achievemem using 
icacher-made lesis and place ihe leacher 
in charge of gathering and analszing ihe 
siudeni achievement rrsulis in ihc class- 
room on a da>-io-da> basr . surelv 
leachers can see areas of performance 
uhere ihev mighi improve 

In shon. the key lo success in ac- 
couniabilii) systems is to protect every- 
one's duf process rights That is ver> 
imponant But we must realize that in 
the interest of protecting those nghts, 
flexibilitv IS necessarily sacrificed to 
consists nc> and legal admissibilitv The 
siriL't legal constraints placed on evalu- 
ation mechanisms can be removed when 
\Ke change our purpose to teacher 
growth 

Through this comparison we see whs 
the same evaluation ssstem cannot serve 
both purposes With accountabihtv . 
leca! requirements preclude the use of 
most ot ihe valuable sources of infor- 
mation on performance Accountdbilitv 
bvsteoiN serve the interests of the district 
ano the communitv b> ensuring com- 
pliant* with minimum standdrds 

This necessarv if we are to have 
gcHxJ schools But It IS not suffkient for 
excellent schools We must also pro- 
mote the continued growth of average 
and outstanding teachers Growth sys- 
tems can help us reach this goal and 
therefore can serve the interests of all — 
teachers, students, the district, and the 
communii) 

The Balance Sheet 

Both accountabilitN and growth svs- 
tems have advantages and limitations 
On the positive side, accountabilitv svs- 
tcms present a verv positive public im- 
age of ricorou'^. hard-nosed personnel 
managemeni — ar image of account- 



abilitN that will satisfs most persons 
who are persuaded ihat this is in fact the 
purpose evaluation is meant to serve 

Further, there is no question that the 
threat of job action motivates teachers 
whose classroom performance is defi- 
cient to slnve to improve 

The potential limitations of account- 
ability systems are that they often 

• Focus on a very narrow definition of 
good teaching (based on a few stan- 
dard performance cntena). 

• Rel> on a verv narrow and shallov^ 
sample of leacher performance (tspi- 
call> one or two bnef in-class obser- 
Nations). 

• Are subject to the potential biases and 
opinions of just one obsene: (the su- 
penisor). and 

• Affect relativel> few teachers and 
pupils 

Growth systems also carry liabilities 
One of these is a role conflict for the 
supervisor As instructional leaders, su- 
pervisors want to help teachers improve 
But down the road ihe> ma> also need to 
make tough decisions about teacher re- 
tention Because teachers and supeni- 
iors know this, trust is often lacking 

It can be risk> for teachers to admi: 
the> need to improve Yet without this 
admission, the growth sn stems are not 
useful It takes time and expertise to 
build an) information system that can 
give teachers systematic feedback from 
supervisor, peers, students — and them- 
selves 

In an> evaluation, questions must be 
thoughtful, criteria specific, com- 
prehensible, and fair Persons unac- 
customed to roles as esaluators must be 
trained to observe, to notice, and to dis- 
criminate between effective and ineffec- 
tive behaviors 

In addition, resources must be pro- 
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\idcd 10 suppon the professional devel- 
opment of man\ teachers — not jusi the 
feu in trouble Evaluation for gro\^th is 
effective onl\ when it is backed b> 
sound inserxice Thus, such sxstcms 
earn \Mth ihem considerable costs 

But uhat do v^c get for our money'* 
Grouth-onented evaluation systems are 
the only systems capable of promoting 
excellence among teachers and schools 
The\ can reach their full potential, ho\^- 
cvcr. onl\ uhen the\ are separated from 
accountabilit) s> stems 

Separating the tuo will take some 
courageous decision making, requiring 
a reexamination of goaLs for teacher 
evaluation and acknowledging that 
accountabilitN — though essential — ma> 
not be sufficient We must also ask how 
much of a commitment and what son of 
commitment to excellence in education 
we are prepared to make 

Will we be satisfied to raise ev^o 
teacher to a defined minimum level— 
possibK at the expense of ignoring the 
supremeK gifted teacher who receives 
no reward under the accountability s:s- 
tems for exceeding minimal standards'^ 
Or once these accountabilitv require- 
mentN are satisfied, do we want to ex- 
tend the resources and the guidelines 
that will let every motivated teacher live 
up to his or her full potential ^ 

What Are the Key Points? 

The essential points are these Ac- 
countabilitv systems gather data on per- 
formance via classroom observation, 
and the results flow to the district for 
review, evaluation, and decision mak- 
ing When the objective is personnel 
decision making. informaMon flov^s to 
centralized decisionmakers and away 
from teachers 

Growth s' >tems. on the other hand. 



gather performance information from 
the teacher, and from colleagues, stu- 
dents, and others and give that infor- 
mation back to the teacher who then 
evaluates it and decides if and how to 
act on It When the objective is growth, 
the flow IS toward the teacher 

In this sense, accountabilitv systems 
are distnct-centcred. while growth svs- 
tems are teacher-centered Which would 
we expect to have the greater impact on 
the qualitv of teaching^ Consider the 
differences between our opening sce- 
nario and this one 



Accountob/lity %Y^ierr\% serve 
the \utere%H of the d\%ir\d and 
the commun/fy by en%umg 
compliance with minimum 
standards. 



'You know, according: to the other 
teachers at schooL evaluations are al- 
ways a waste of ttme The\ sa\ the\ 
ne\€r get anything out of it ^ell I sure 
got a lot out of It this \ear' That's proh- 
abl\ heiaiise I was a new teacher and 
ha\e a lot to learn 

For instance, right a\\a\. I found 
out how diffuuh It can he to manage 
kids W e talked about all that classroom 
manaf>ement stuff in college— hut it's 
different Vihen \ou re standing in front 
of them on your own for the first time 
The\ let me try it for a week, then Jud\ 
showed up Thank God she knev^ ^'hat 
to do 

"The primipal had arranged for her 
to spend time ^ith me for the first quar- 
ter Jud. and I took one step at a time 
She wauhed what the kids were doing 
and my management skills Then sht 
told mi what she saw Sext we dis- 
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cu%\cd ^shiii to do different l\ Th( next 
da\ she took oxer and I matched — and 
learned Then I tried again and I mean 
the ktds v\ere on task' / has amazed' 
Her tactics reall\ worked 

"As we worked together that term, 
she watihcd. demonstrated, and pro- 
vided suggestions I tried and sometimes 
I failed-— hut my confidence w as build- 
ing Even couple of w eeks the principal 
showed lip to let me know how pleased 
he was with m\ progress 

"I realh felt like the\ cared because 
the\ took time to watch mc and show me 
how I'm not sure what I had learned 



bejorehand—hut I know I would not 
ha\e sun ned without them Did I learn 
anything from evaiuation* You het*" 
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Inl(^ri*^l m a**<;r<;»»mp Irachcr jx^rforni- 
ancr ha^ lieightpiu^d in \hv la^l decad(^ 
More than c\(t brforr. parriil> want a^- 
surancr that liMrhrr^ arc roniprlrni 
professiondU lust uhrn schools are 
plajiurd hv spiralmg costs, drclining pn- 
rollments. and dwindling resources, edu- 
cators arc pressed to scrk heller w.iys of 
assuring <|ii«dil\ insirU(lion Kffe*live 
loacher eVdlualmii is one w.iv lo r»M( h 
that goal 

Educators are concerned ahou! Iea( h(^r 
evaluation for maiiv spe; ifu r(»asons 
Ho\ve\ . as Millnian (IMHl) notes we ( ,in 
distinguish helween Iwo maior Ivpes of 
loarher evaluation formative and simi- 
mative The po«ti of fornuitivr evaluation 
IS lo identifv lea( hers* own slren^lhs and 
weakness( s and plan appropriate profits- 
sional development aclivilies. Summalive 
evaluation result«». on the other hand. pr(»- 
vide a base for administrative decisions 
involving hiring and firing, promotion 
and tenure, assignments and salary. 

Clearly, formative and summative eval- 
uations serve different purposes, but both 
are important. Summativc evaluations 
are designed to ensure that highly quali- 
fied educators enter the profession and 
continue teaching Formative evaluations 
help those alread\ tentbing to d(*V(»lop 



#4(in.B MHlir^ with tlir N.ihon.^l lU'^ntiih of f <iih h- 
lidfi Op}ni(Mi»« <Aprp».».« d in (hi*' p.ihln rfimii rif) not 
npfpss»iril\ rrfici \ \hr position of Ml and no offu ihI 
««nHrtr«irmoni -.hcuiid hv mfrrrrri 



and refine vital skills Most teacher eval- 
uation conducted today attempts to do 
both simultaneousl\ . In practice, how- 
ever, nost evaluation practices address 
summaiive goals. Formative teacher eval- 
uation — potentially important in instruc- 
tional improvement and individual dc*- 
velopment — often assumes a secondary 
role 

Neither summativc nor formative 
teachi^r evaluations, as currently con- 
ducted, serve their respective pur|>oses as 
well as tbev might Neither the environ- 
ment ni which suniniative evaluation is 
conducted nor the as.sessment procedures 
used for that e aluation are as effective 
as the\ could be Formative evaluation 
offers a potential seldom realized simpK 
because it demands mor(» time and effort 
than many evaluators can afford In both 
cases, a new course of action is needed if 
t* fKitential of teacher evaluation is lo 
be rcahzed The research project de- 
scribed in this report is an attempt to chart 
pari of that course 

This investigation addres.ses problems 
and solutions associated with formative 
evaluation. We do not wish to imply that 
formative evaluation is necessarily more 
important than surr.rr.ative Both are po- 
tentiallv valuable But issues of teacher 
selection, retention, and promotion are 
already receiving widespread considera- 
tion, we feel teacher improvement needs 
more effort and attention If overall school 
improvement is our primary goal, then 
teachers* professional growth and devel- 
opment become paramount 
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Furlher performance assessment — the 
obser\alion and rating of behavior — can 
make a significani contribution to teacher 
evaluation w hen used in a formative wa\ 
For reasons tha! will be outhned. the rules 
governing summative evaluation often 
preclude the use of much potentially val- 
uable performance data Formative eval- 
uation free of such constraints, offers a 
richer source of performance information 
on which to base teacher development 

Our goals in this study were first, to 
understand current teacher evaluation, 
both its problems and potentials, and sec- 
ond, to identify ways that evaluation can 
be effectively used to promote teacher 
development To reach these goals, we 
addressed four questions How are teach- 
ers typicalh evaluated' How are evalua* 
lions used to foster teacher improvement' 
In what ways can evaluation and devel- 
opment be more effectiveh linked' What 
barriers prevent linkage? 

In answering the^e questions, we (a) 
reviewed current ;esearch on teacher 
evaluation (b) reviewed current laws, 
regulations and contracts pertaining to 
local evaluations, and (c) conducted case 
studies of teacher evaluation policies and 
practices in four school districts In addi- 
tion, we conducted a working conference, 
emphasizing formative teacher evalua- 
tion practices and priorities, with task 
forces of principals, teachers, and district 
administrators from each of the four case 
stud> districts 

Research on Teacher Evaluation 

The majority of school districts look to 
teacher evaluation as a means of improv- 
ing teaching performance (Bolton. 1983: 
Educational Research Service. 1978) But 
f iven the ineffectiveness of current eval- 
uation approaches, most are not achieving 
this goal to an\ impressive degree To 
understand wh\. we explored four di- 
mensions of teacher evaluation, the 
current context: characteristics of con- 
structive, formative evaluation systems, 
research on the status of evaluation prac- 
tices in schools, and the role, actual and 
potential, of evaluation in fostering 
teacher growth and development 



The Context o'' Teacher E\ aiuonor 
The current context of teacher evalua- 
tion IS chang.ng Donald DuBois former 
coordinator of staff development in 
Salem Oregon, explains part of the im- 
petus behind this change "Teacher eval- 
uation, historically, has been a mess 
Teachers often feel naked and defenseless 
by the *insi>ection' and 'report card' sys- 
tem For principals, the teacher evalua- 
tion process is a gut wrenching, time con- 
suming duty" (Lewis. 1982. p. 55). 

Educational administrators are aware 
of problems with current evaluations Re- 
sponding to a national su vey by the 
American Association of Secondary Ad- 
ministrators (Lewis. 1982. p. 11). admin- 
istrators specified the following needs 

• Better definitions of effective teach- 
ing Although many evaluation pro- 
grams attempt to define effective 
teaching, most definitions center on 
teachers* behaviors — not on appro- 
priately measured outcomes 

• More trust in the process" As one su- 
perintendem put it. "We need to 
know how to evaluate people and get 
them to feel good about it In many 
places, the 'spirit*' of evaluation has 
been so structured by teacher con- 
tract agreements that it is almost *'pro 
forma." 

• Proof of the link between evaluation 
and instructional improvement Until 
there is some specific indication that 
the process is worth the trouble, some 
say It wuU remain "pro forma " 

• More specifics on evaluation tech- 
niques: Conferences, personal goal- 
setting, classroom observations— 
these are common approaches to 
evaluation, but administrators want 
to do them better. 

• More sensitivity to the needs of the 
cvaluator. primarily the principal 
Many participants feel they have nei- 
ther the skills nor the time for suc- 
cessful evaluations. Evaluators won- 
der what kind of training they should 
have and how they should be evalu- 
ated to be sure the system works 

As these comments show, administra- 
tors are often frustrated by current prac- 
tices Evaluation is time consuming, po- 
tentially disruptive to staff-administrator 



ERIC 



2> 



PerloTTia'^ce Assessment 87 



ri i.*:h':i'^^ oflcr. d>^truvtrd and rriti- 
ci/("^ h\ t('d Ix and srrnjing!\ ineftt ^ - 
tiic'l II mipro\ iiig in<^tructiO!^ 

Tcfi. *ier^ rf!^o are critical of evaluation 
|)r(ue(iure< Thr\ often contend that the 
a<i«»essnvnt method^ used are inappro- 
pruitr TIh performance criteria b\ whuh 
the\ arr lud^^d are either unspecified or 
Ino prnerril classroom observation? are 
jnfreqiir:-;! and <iuprrficial the factor^ 
exoluritiT! oltni have little rolaljonship tc 
in<ilrijctif>n sup^r\Jsor\ evaluations are 
loo (»ft(»n ^ubjectivf ba'^ed more on per- 
son, » I c hdrar terislics than instructional 
skill and revult^ are either not commu- 
nicrttrd or are not useful in improving 
porforn^arKe {Bohon 19"3. Borich & Fen- 
toil Natnello & Dornbusch. 1980- 

Kc(('i^it sur\r\s of teachers* altitude<i 
about exdluation bring the^e probleni*< 
into ^harper focus For example Wood 
and Pohland n^79j report that onl> 28^ 
of the iteni^ in school districts' evaluation 
f heckli^t^ examined relate to the instruc- 
tional role of the tear her ^ feu additional 
itt'nr dcd' will) relevant personal char- 
iHii rivtn^ 5;u( h a*^ rei-pon<iibi]it\ and en- 
iKusMvt;; Bu: the renidinn^g (h'-ckh**! 
il( nis rrlah' \v behavior outside the tla^^- 
rocm: menilu r>hips ii: organizations and 
pcirn. ipcjtioi^ u) professional social and 
afnnin>trH»!\e aftuHie^ in other words 
tin (ntrriii u^^d m these instruments 
not» \\ oon and Pohland appear unrelated 
to iniprr>\m^ teaching performance and 
of I'T hi tie assistance in ( hanging leaching 
pr.if til ( - 

In v^udic^ conducted b\ \atriello and 
D(.>rni)U^v h teachers noted that 

th( \ Mewer thpir evaluation s\si?njs as 
generdll\ unsound overl\ subjective, and 
unaffected b\ Iheir efforts Teachers in 
these studies indicated that evaluation 
criteria were seldom shared with teach- 
ers that teachers were uninformed about 
the information coilected to evaluate 
their performance and that minimal time 
w as taken to communicate evaluation re- 
sult^ to them The authors note. *The 
teachers in our inler\iew study reported 
that on the average the\ received formal 
evaluation^ from their principals once 
everv 3 vear«^ * Moreover, in these teach- 
ers perspectives, evaluations were unre- 



lated to the santlioiiv or rewdrds (»f th'* 
svstem arui hen( r "hfni httii valui (p 

Le\in (197^) m a summarv of researc h 
on teacher e\aluatiori argue*^ that "re- 
search provides little .support for current 
practices in teacher evaluation " He goes 
on to comment. "One of the few thinp*^ 
that can be safelv said is that the preva- 
lent system of evaluation through ob- 
servation bv supervisors is biased and 
sub)ecti\e The use of techniques that 
have greater promise for providing objec- 
tive data, such as observation instruments 
. . . IS cs yei uncommon' (p 244) 

Designing u More Constructive 
tn^ ironment 

Dissatisfaction with current evaluation 
procedures and outcomes has prompti'd 
manv educators to propose substantive 
revisions — revisions m plannir^ in de- 
signing performance criteria and acquir- 
ing meaningful dato. and in communicat- 
ing results to teachers The following sug- 
gestions represent a concise cross-section 
of current thought on what strategies 
might make evaluation practices more 
constructive and (*flective 

Manalt (1982) a major proponent of an 
e\aludtion n'odel being tried in schcjoi 
districts across the country, advocates an 
evaluation svslem manilesling these fea- 
tures (a) teacher involvement in the eval- 
uation process (b) centralized and collab- 
orative development of performanc e 
criteria based on research and on locdl 
priorities, (c) goil setting (d) multidimen- 
sional method*^ for assessing teachers* 
skills including objective data gathering 
and sell- and peer evaluation (e) analvsis 
of results with teachers and development 
of specific |ob targets for improvement, 
and (f) inclusion of a preobservation con- 
ference to acquire background data, and 
postobservation conference to mutually 
analyze classroom data and set goals for 
improvement 

Manatt s model strongh icfiects the 
posi'.ive impact of clinical supervision, a 
colle;^ial process of professional develop- 
ment designed bv Harvard School of Ed- 
ucation faculty in the 1960s Clinical su- 
pervision IS a system in which teacher 
and supervisor work together to set goals 
and determine progress This collabora- 
tive model includes three major steps 
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pr^'()l>^or\ tiUun conteriMUi's to exchdn^f 
Kiiruuiui intorm<iiion and to mulualU 
ishi[)lisli and nuMh^ni'. tor jiatht^rint; 
data nuillifilr clds^room obNervation^ 
that nu ludi* collcLlion ol objectjvi* data 
and po.stob.servation conferoncos to ana- 

.nd \erif\ data and to colldhoratix 
dt'M'loj) a sNstcmalK plan fur improvi^- 
nieni In addilmn leac her and supervisor 
< oniniunu ate t»\tensi\ el\ throughout the 
i*\aluatK)ti prcxcss to iMisuri* that the 
ht r hd.s a r(Ml voko in drterniinni^i 
evaluation procedures ai.d setting ^oals 
lur prote*;sional j^rowth Although clinu al 
supervision nietliods have been adopted 
priueduralK b\ districts acro*is the ruun- 
tr\ the heart of tlie le.u her dexelopnienl 
process — frequent obs(r\ation and dis- 
{ usMim — bas not 1)i'«mi sui i es^fullv im (jr- 
poraled into most local s\ stems 

In re^ponsf ti» \alid (onierns about tlu» 
pertunitor\ nature ot most evaluatiur.s 
and reiiaiue on subjective observational 
data man\ edut.ators ur^v- the use oi |a) 
ass(*!>sment methods that give more ade- 
quatt> and ob}ecti\p data about classroom 
mterarlions (verbatim records, charts of 
classroom interactions records of ques- 
tioning or reinforcement strategies) and 
(bj Use o! multifile evaluation procedures 
(student dv^ peer evaluation assessment 
ot student products) to provide a more 
comprehensive picture of the teachers 
pertnrmance (O'Hanlon & Mortensen. 
1H77| I.evin (19791 reinforc es the need for 
'more extensive use of student evalua- 
tions and less reliance on ratings b\ prin- 
cipals and other supervisors " He also con- 
cludes that "reliance on a single evalua- 
tion technique i«i unwise" (p 244J Since it 
reduces the possibilitv that the teacher 
v\'ill be judged fairlv 

Following a comprehensive analysis of 
current teacher evaluation practices. Dar- 
ling-Hammond Wise, and Pease (1083. p 
32(1) s[)erifv four minimal conditions for a 
successful teacher evaluation svstem 

• all individuals in the sys.em under- 
stand the criteria ai^d processes for 
leather evaluation. 

• all participants understand how these 
critc^ria and processes relate to the 
basic goals of the organization, that 
is. tb ere is a shared sense that the 
criteria reflect the most important as- 



pects oi teaching tliat the eVd!uatu>n 
svslem l^ consonant with their edu- 
cational gojLs a'M conv eption^ ot 
teai lung. 

• teachers perceive that the evaluation 
procedure enables and motivates 
them to improve their performance, 
and principals perceive that it enables 
them to provide instructional leader- 
shi[). 

• all individuals in the evaluation per- 
ceive that the evaluation proiodure 
allows them to strike a balance "be- 
tween adaptation and adaptabilitv. 
between stability to handle present 
demandsand flexibilitv to handle un- 
anticipated demands" (Weick. 19HJ 
p b74) that IS it allows participant,> 
to achieve a balance betwt^en control 
and autunomv 

Achieving o More Conslructue 
Environment 

How extensivelv do current school 
practices incorporate these commonlv ad- 
vocated criteria' In summarizing a series 
of surveys of evaluation pracli- e<i knapf) 
(1982) contends that despite strong advo- 
cacv ol multiple information sources in- 
volvement of students and peers, and 
more ob|eclive means of collecting data, 
schools have not reallv changed their ap- 
proach to teacher evaluation Principals 
still do most of the observing staff are 
seldom involved in planning, and there is 
little real effort to use evaluation out- 
comes in designing constructive staff de- 
velopment 

Similarly, a recent analvsis of 32 h'ghlv 
developed current teacher evaluation .vs- 
tems across the country, completed by the 
Rand Corporation under sponsorship of 
the National Institute of Education, pro- 
vides the following insights regarding 
evaluation practices (McLaughlin. 1982) 

Exemplary programs displayed a num- 
ber of common features Nearly all of the 
32 programs studied required a preeval- 
uation conference (88^c). classroom obser- 
vation (100/f). postevaluation conference 
(lOO'^). a written action plan following 
evaluation (88^). action plan follow-up 
(81*^0. and the participating principal as 
primarv evaluator (78^0 Few. however, 
used self-evaluation (38^f) peer evalua- 
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lion (2^^r I. or studenl^' achie\ onieni data 
(22^ I m r\aluatmp learhers 

Dospiir ihoso similantios McLaughlin 
(1982) suRpr<it? "Ihore is scant agreement 
about instrument^^lion. frequency of eval- 
uation role of tl. leacher m the process, 
or how the mfurmat'on could or should 
inform other district activities * (p 11) In 
other words, httle consensus exists about 
'b(»st prattue ' Moreo\er. although 74^f 
of thr di^trut^i named school improve- 
ment or stall development as the primar\ 
goal of the s\slem, few districts estab- 
lished thf nece<;sary links between 
tea( her e\ aluation and staff development 
to m^ke thnt goal achievable There is as 
the^tud\ notes "a general lack of integra- 
Uor\ l)et\\ n \earher evaluation and staff 
dexelopniont or distru t curriculum 
guides' (ji 111 Thus although exeniplarv 
procrnn^'^ appear to emphasize staff de- 
veiopmiMi* and school improvement, 
teacher evaluation operates more often 
than not a«i an independent, self-con- 
tamed ^\*item not an integral component 
of a broader staff development program 

Efferfj\(' Formofi\'P t\*alualion Elusive 

re(ent ^tudie^ point out. oven higM> 
de\eluj>p(i teacher evaluation programs 
seem tc) lac k procedure** or organizational 
link*« e^vcntMl for s\steniati( individual 
ar st.iff (le\ fldpnient through teacher 
evaluation 

Knapp (1^821 notes strong formative 
r\ .ihintio!! propram«i require both staff in- 
vol\<'nirnt and a specified relationship 
between leather development and eval- 
uation But de«ipite the urging<i of re- 
sear(her*« and educator*^ themselve<i not 
murli hiv happened Knapp <itate<i al- 
though effective evaluation of individual 
tenc^er^ tan provide "a more accural" 
pirtur(» of an individual teacher's need<^ 
'ban for e\.mi})le. the group need*^ asses*;- 
nient^ (onimonK ii^^fMi »»v«*teniati( 
v\ nluiilton nl indtv idu.il t(>n( lier^ doe<; not 
(\^ vet appear to hv a ^^t.indard part of <itaff 
development plnnnmg" (p fl| 

Holh^ ITIHJ) (ontr'iid^ that di^^lrirt^^ 
nrcd In niakr better us(> of evaluation 
data "WluMi evalualor rating*^ are sum- 
niari/j'd .h ro*^^ ( ompetfMK ie«i or area*^ the 
tr,nnin^ ne^^d'. of l)()tli evaUnitee^ and 
p\alu.it(»r^ (»nieru'** (p 7] Di^trnt and 
buiiiimu ^umin.ine^ (.ni be instrumental 



in identifying staff development ne>'d^ 
"The data." argue'i Hollev "should be c dp- 
tured and used for the impro\ement of 
both the evaluation process and instruc- 
tion" (p 7) 

While teacher evaluation practices are 
becoming more systematic procedurallv 
most arc still insufficient to support viable 
teacher improvement programs T* achers 
want, at the ver\ least, an e\aluation s\*»- 
tem that provides accurate information {>n 
classroom needs, opportunitv to acquire 
and masier new learning approaches, and 
collegial support when instigating needed 
changes These activities demand more 
time, instructional involvement, and 
more thorough assessment than manv 
principals seem to find manageable A'^ a 
cunsequence, practice^ become more for- 
malized, remaining basicallv unchanged 
Moreover, as the next section indicate*^ 
changes in practice ma> occur more in 
response to external pressures than to in- 
ternal needs 

Factors Regulating Teacher Evaluation 
Practice 

State teacher evaluation laws and reg- 
ulations can influence local evaluation 
practices, as can collective bargaining 
agreements This analysis explore^ 
whether these laws and contract*^ pro- 
mot(» or constrain the Jse of evaluation 
for teacher development 

We begin the analysis of state laws and 
regulations with a brief summarv of the 
national picture, then comment on di<^- 
trict/teacher association contracts 

Teocher Ex aluafion Lqw*- 

Twenty-six states current!) have law** 
requiring teacher evaluation, according to 
Wuhs and Manatt (1983) Though an 
equal number currently have no laws, the 
number of such laws has increased dra- 
maiually during the pa<;t 12 years, with 
over BO'^f of all laws enacted since l^^l 

Wuhs and Manatt. for example, report 
that in nt ly all states improvement is a 
primary purpose, in almost half, evalua- 
tion data are also used for personnel pur- 
poses Beckham (1981). by contract, re- 
port«i that less than half of the states li^^t 
<;(hool or teacher improvement a^ their 
primarv purpo^^e and that the remainder 
of laws ser\e per^cmnel decisionmaking 
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luiH tions 'I Ins dpjuirt :it rcpdiH \ ni.iv 
sim|il\ nuiudir iJuii must rvcilu.ilu^n Liu^ 
MTM' ihiilti[)lt- purposrs aiul olU n ulititn 
tuddilrrss hutli lurnuiDxi diul suninuitivi' 

IssUi'S 

Tlirri'-qurirtLTS uf llit* sidtes li'-^vi* lon- 
lri)l ol i'\dludliun pru( rdures lu lucdl tiis- 
tri( Is \'i'r\ spiu \\\ ( nli*nd lu bf c\ dl- 
Udh'd And still IfWtT pruvidt^ din ^UJ^lt'• 
liiit's k)r tln' d('\ {'lu[)nuMil of Icdl s\ slenis 
Su il Is dp[)i)n>]itl\ IcKdl diHisioiis nut 
stdlf nidndrilcs thi»t di'tt-rniint' most dis- 
(rut ('\dludtton prcK.uduM'.s Snit Kudl 
pr.K t'diiri ^ ti'' * -.t cj! 1 jted ri> pdrt ul 
ujlU*tii\f bdr^jinin^ d^rft'mcnts. ds d 
KfiHTdl ruli'. stati' Idw^ would d[)[>rdr to 
\)ti\i' mininiid MifliKMKf un [ironiolin^ or 
limHiDf; lira loi dl eni[)hdsis on lornidtixc 
Irai liiT t'\ idUiilKUi Thi'\ nid\ howtAiT 
indimtK imprdc iDrmdtixc priutucs hv 
rt'tjuirnig i tTtdin [)ru( udurt's. mu |i ds usr 
ot unjlorni nidiiddtt'd cxdludlion repurls 
ur n^iid s[)et incdth)!! ol tOdLlnng cnturid 
unri'ldlt'd tu distrit t-idt»ntifn'd Ictuliin^ 
pruintii's 111 sm li instdnifs fXdludtors 
nid\ lirsi nu'ct tliclurmid sidtc-mdnddlfd 
requirements und then nid\ de( idr tlwit 
inipK'inentdtiun ol addi'd lornidtue [)rdi- 

llies is iu)t jdj neii'ssiM\ or possiMi 
Ki\ en ulliei (inie denidnds 

Although some stdte IdWs do inLliidi* 
some proMsjon for ted{ her development 
most dre Idr less [jres{ rjpli\e ihdii lln' Idw 
pdssrd \u Lt)nnei tic lit fur the purpuse of 
nidnddting formdti\e c\dludtiun Lon- 
nectuul h!dte Depiirtment of Ediualion 
imrMj ^iindi'hnes s[ji*{il\ the follow in^; 
e\dludtion methuds 



• rooperdtive pidnmng between profes- 
siondls dnd e\dliidtors of the eojec- 
iiM's ol ed{ h nidividudl evaludlion. 
the e\dludlion procedures, dnd thr 
process of c»vdludting the s\strni by 

Sldll 

• c ledr spec itic dtion dnd eonimiiniLd- 
lion of llie e\dludtion purposes ds 
well ds tht» specific responsibilities 
diid tjsks thdt will serve ds the frdnie 
ol reference for individual evdiud- 
tions 

• o[jpurluiMt\ lor tiMi hi'rs t(j e\alucHe 
ihenisfUrs in [)osjti\e dihl coiislriH • 
tiM' w d\ s und 



• eni})hdsLs un clid^ncjsti^ riitin r th.ni 
e\dludli\e dssi'ssnienl tin 
attention gi\en to diidl\/in^ ddlic ul- 
ties pldnning impiov einents dnd 
providing c lear. persondlized. con- 
structive feedbdck 

As our discHission will show, those state 
guidelnu\s dllempt to estdlihsh d stronger 
tie between ledchrr evdiudtion and 
tedcher de\elopnient than do most 

The J/n/)or( of (^o/ierlne Borgnining 
Agreements 

A nidjor force in defining and limiting 
dibtrn I teat her evaludtion procedures hds 
bet'ij the culicc ti\ e bdrgdining dgreenu'nt 
Its clin'l iinnact Ints been to pru\idf dut^ 
process sdh'gudrci.. for tedthers Accoid- 
ingtt) Strike diid Bull (VJH1). who studied 
numerous such dgreeiemt^s. ihesi con- 
trdCls dltect the evdiujtion process b\ 
specifying the frequency of e\dludtions or 
observdtions. informing tedcherr. of evdi- 
Udtion criterid. restricting some methods 
of inlornidtion gdthering (eg unaii- 
nounc eti \isits. secret monitoring, elec- 
trcnnt equi[)nient etc ) and specif>ing 
uht» cdii diid Cdiinot pdrtu.ipdte in the 
e\dludtion process The\ diso often re- 
quire lornidl communicdtion o^ evdIud- 
tion results reguldte written re[)orts (e g 
conhtlenlidlit\, opportunit\ ford written 
response b\ ledchers) require renn^did- 
tion for negdti ve e\ diudtioiis. allow union 
representation at dll conferences dnd pro- 
cedures, and necessitdte thdt notice and 
redsons be filed for disc.iplirir > dcl;on. 
disniissdl. or demotion 

OverlK, the effect of these contracted 
agreements is to promote uniformity and 
specificity in evaluation procedures But 
because of the adversarial iidlure of many 
contract negotiations, teacher evaluation 
IS becoming more rule governed and fo- 
c used on cledrh specifnul nnnimum work 
stdiiddrcls (Mitchell Kerc liner. 1903J 
Collective bdrgaining hds done little to 
promote links between tedcher evalud- 
tion diul mdividudl devi»lopment Al- 
tliough It has often clarified cvdiuation 
requirements, it also has made evaluation 
procedure's niore impersonal dnc! rule 
goveriuHl and it has umntentiondllv in- 
tioiiuced another dimension of divisi\e- 
ness into * In- proi ess 
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The letidl and contrarlual fH(!or«s ^o\- 
orning lt»d' ncr (nalunlion arr txpunlK 
d^^ii^nrd |{> «itfindardi7o ovalu.ilior, ro- 
qiiirrm(»nt^ arnl to promote dur pr(>( ('»*^ 
in sumniali\o ovdluiilion B\ promoting 
adhoronco to fair pradur^i in porsonnrl 
dof i^iionniakmp howrvor lho\ ha\o in 
pffoi f dirorlcd allonlion lowaril lopnl r(»- 
quiremrnl^ atid a\\s\ from molhod^i for 
promoting toat hen growth and dp\plop- 
men! Ahhough it is encouraging to find 
some .';lalr hi\\<- altonipling lo strike a 
balanio holwoon formdluc and siimma- 
tivo loachor o\aluation the laws only set 
an o\prall rontpxl for practice in dislrif Is 
and s( hooK Their effcclivenps*; still de- 
pond^ on interprcM.ition and iinplem(»nld- 
tion Remilation^i m.i\ inderd pnhcUire the 
potcnIiHi for inipro\rnienl. or lh»n ma\ 
bp viewpti one more •■^quiremenl 

to ho mot ihii'- ha\ing littlf ^.uh^tdntive 
impiKt on iii*itru{ tional changes 

District Teacher Evaluation Practices 

What inip.u t do existing laws and ton- 
trad*^ artUfilK have on locfil evaluation 
practice^' Do the same teacher evaluation 
issues identified in national stuilie*; lUo 
concern local (h«;tri( t*;*' \\ hat practK do 
local progr.mi^ u'^e lo promote ltM( lH»r 
development To answer these que'^lions. 
we Jisked four Pai ific \orlhue«il «ichool 
di^lrift^ to participate in ca^e '^tudie*. of 
Iheir lea{ her evaluation s\steni^ The re- 
s\jlt^ a(i(le(l nuif h detail lo our under- 
s^antlm^ of the e\alualion environment 

Ca^t SUi(i\ Desrriplion 

To learn aluuM teac her e\.ilu.ilKni pra{ - 
lice«i in lhe<:e di«ilrut<« we conducted 17 
interview «; with district administrators in 
charge of teacher evalualmn ainl with 
iMiilding priiK ipaU |eh*]nentar\ . pinior 
hivh and hi^li s( hool) In addition each 
princi[)al wa^ a'^ketl lo name 4 teachers 
fror^i fier or hi»- hool who would respond 
to a que^tiono.nre nn leather evalualmti 
practice*; '^orlv-eighl teacher*^ received 
questionn^ures and 10 res|>oiided 

Parlic ipanis w ere a^^ked lo de'^crihp 
teacher evaluation practices from their 
viewpoinl Further the\ were a^^ked if 
and how lhe\ u^^ed result*^ lo plan teacher 
development InterMew*^ and question- 
natre*^ tou( hetl on si, He ,ind di»^lri( I poli- 
{ ie»* de\elopineri' of evaluation proce- 



dwTv^ method** for gathering infornLi'in:- 
on leather performance methoiK for 
comnuinii atmg evaluation re^iulK to 
lea( her**, and relati|(» satisfaction with 
their evaluation system In oui lining w avs 
evaluation data are u? i. administrator** 
and principals de*icri^ ne specifK de- 
ci^^ions — summativc ^ lormati\'e— in- 
fluenced bv the r^' Thev were also 
asked what role tvox- r ^valuation pla\** 
in promcMng teacher .growth and im- 
provement Results of the interview*; and 
questionnaires are summarized below 

Cose S'u(i\ ^sulfs 

In summarizing case slud\ result** w(» 
fotind evaluation proc^ure*; to bv sink- 
ingl\ similar across districts Forexamf^le 
all district*; used a three-stage evaluation 
proce*;^ including a pie- and postob**er- 
vation conference and classroom liuser- 
vation The observations, conducted 
either by principals or vice-principaU. 
were the central feature of all evaluation*; 
Th(»v occurred formalK either once or 
twice a vear Peers and students were 
seldom involved in the ev^iluation. self- 
evaluation** were ciirsgrv if done at all 
and stud, nl achievement scores were not 
used Results of the evaluator's observa- 
tion were communicalf^ both in person 
and in writing to the leather The writlen 
reports callecl for supervisors to de*;cn!>(» 
teachers' strengths and weaknes**e*. on 
either stale or locally specified criteria 
None of the districts used rating scale*; or 
\ui\n alions of performance levels to iden- 
tif\ tc»ac hers* skills Finally, training pro- 
vided evaiuators ranged in one district 
from a frequent, integrated program that 
involved all staff to intermittent or spo- 
radic training in other districts In addi- 
tion, both teachers and administrator** 
saw room for improvement in the evalu- 
ation process and made specific recom- 
mendations about ne(»ded changes 

Teochers* pr»rspecfi\'es on needc^cf 
changes The primar\ goal of our case 
studies was lo identifv barriers precluding 
use of teacher evaluation result *i for 
teacher growth and development In the 
questionnaire, teachers were asked for 
their perspectives on |a) needed changes 
in the teacher's role ifi evaluation (h) 
needed ch..;^ge*; in di*;tri( I proc edure«^ 
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d\u\ |i j Jll^.l^ tur iniproMii^; qu*ilii\ ol 
h'di liMiw in the distru t 

\\ ith Tvs\n\ ! to tlu' teat mlv ()\rr 
hall I sponlanfuuslv urfifd morr op- 
pi)rlunil\ lur (.DlU'^ial obst-rv aUon aiuJ Kir 
scll-exdludlion through goal setting and 
\ideotaping Others suggested more pro- 
liLiencN m evaluating lessons and giving 
tea( hers nio e knowledge ahout what 
( unslilules eflei tive teai hmg 

Kec.oninieiidations fur iniprovcnients m 
the overall evaluation svsteni were far 
niort* extensive KupealedU . teachers sug- 
gestecl more Irequent lornial and informal 
obs(T\alion.s greater use of peer obser- 
\ation and self-evaluation aiui more ef- 
lei tivr prep.iratjon aiul Irainiii^: ftir ♦•\al- 
u.ilors in .ulditioii the\ uillrd ttn hetln 
ohserv a! lun.il strulegus inon flleitiv.' 
I oninuiim alion of results vMth emphasis 
on spr{ii,i .sugi^eslioiis tor irupro\eri)enl. 
iiu ledsrj skill among ('Valuators, and bet- 
lei general management of evaluation 
Teachers also noted that the> need qual- 
il\ insiTVKf training to improve their 

skills 

'le.uhers seemed to <igri'e that to l)r 
ellei ti\e. evaluation must (a| be a \alued 
schoolwide pnorit\ not lUst a require- 
ment (I)) o{ I ur IrequentK enough so tlial 
outccn es reflect actual classroom activi- 
ties (t) incorporate methods that provide 
relevant specific and complete informa- 
tion and (dj involve evaluators trained to 
provide sperifu useful suggestunis for 
improvement Kepeatedlv teat hers called 
for more frequent feedback and for con- 
structive critiusm. not "vague gencTah- 
lH*s thai hide medioc re teaching ** 

Adnunislralurs' perspec li\ es on .iet de(f 
changes HovN satisfied were principals 
and district staff with their evaluation 
s\ stems'' Responses differed considerabK 
across districts 

In twu districts, administrators were 
generally satisfied with the evaluation 
process, ^ut were concerned with the 
amount ot time available to conduct ob- 
servations In the two other case study 
districts, administrators were less satis- 
fied Reasons for dissatisfaction included 
teachers* lack of trust in the evaluation 
process lack of clarity in criteria and the 
fatt that evaluation seemed more ori- 
enl'»(i to meeting slate standards than pro- 
moling imp'' n emenls 



Siiuiiaih. not dll agrrt-d that teat r 
ev.iluttlion led to teai her impii»vemenl 
Sonir felt that the goal selling proc ess v\a^ 
,t niaioi step toward iniprovemeni ami 
lhat. iiu reasinglv . evaluation was loi us- 
ing more on improvement than on judg- 
ment Others felt the link was vseak at 
best Prnuipals also generally acknowl- 
edged that evaluation results were not 
directlv used to plan school or districl- 
wide stall development, and that local 
supervisors did not include evaluation re- 
sults in setting instructKMal priorities 
Evaluation was. however, used by some 
evaluators to help teachers ideiitifv indi- 
vidual goals and to spec ifv a plan of action 
lor the veal The complelion of these 
pLnis .Old their efle< I on iiislruc tioii was 
seldom ni'untured 

These administrators cited four ma)or 
barriers limiting the developmeni of a 
more lormative evaluation system (a) 
teachers' lack of trust iii the process. (b| 
msufiu.ieiit time lor evaluation, (c) the 
adversarial context of evaluation, and (d) 
princip.ds' skdK as evaluators The trust 
and time issue s v\ere mentioned most fre- 
queiitlv Prim ipals also iiolevi these prob- 
U'ms iiuoiisistent evaluation procedures 
imprecise requirements lack of training 
for evaluators. imprecise dismissal pro- 
cedures, overlv general evdluation out- 
comes, leac hers* resistanc e to change and 
inadeciuale slaff development Admini-- 
trators noted too that manv piinc ipals die! 
not know how to establish evaluation pro- 
grams or set realistic priorities 

When asked how evaluation could be 
more directly related to the improvement 
of teaching administrators recommended 
changes in system management, includ- 
ing increased staff involvement in goal 
setting and emphasis on improvement as 
a district priority, improved methods of 
conducting observations, more time al- 
lowed for evaluation and observations, 
development of evaluators' skills, a 
stronger link between evaluation and staff 
development, and accountability for all 
principals conducting evaluations 

Yes. say supervisors, evaluation could 
be more effective in diagnosing teachers' 
needs and improving their skills— but 
onlv if the process c fianges m manv wavs 
And the major ( hanges called for closeU 
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pHrnlld \h[)^v (on(^rn*^ jdrntifird in n«T 
Ijoiiiil «;lu(lirs of \ Vt\i hrr r\ahu»M()i: 

/\ Confi rf'Mf r nil lv(U hrr K\(i/u(ihrni 

As a conclusion \hv case studios. v\p 
inviird lram<i of rducalor^ — each tram 
including a dislricl administrator, princi- 
pnl. and trachrr — from each of thr four 
casp stud\ districts to atlrnd a working 
conforence and consider in greater drpth. 
methodv for more effectiveK linking eval- 
UHtion and staff drvrlopment in the dis- 
tricts Coiifrrencr teams discussed two 
maior issues (a) the barriers to more form- 
ative evaluation and (b) potential ways of 
linkm^p\rilu«ition more c losrK to teacher 
impro\pni(»nt 

Afirr rpMPWuic th(» results of the case 
studies conferrncr participants worked 
togpllirr to produce the following roni- 
nion Imt of biirrier** to formati\e teacher 
r\aliMtu)n (lish»(i m order of importance) 
in their districts 

1 r\.^hiator«* often lac k important 
skilK neecic»ci to e\aluate. and the training 
needed to solve thi^ problem is frequently 
not available, nr't used, or ineffective At 
IcMst two s(»t<^ of skilK ATv larking (al <^kllls 
in evaluating teacher pfrfcirniHiu e and 
(b) skilK in comniuniCHting with te*lchei'*^ 
about the evaluation proc e«*«. and result** 

2 Tliere is often insnffineni time for 
bolli evaluiUion and follow-up A (ontin- 
ucni"* cAcIc 01 fee(ib;u k and growth is 
needed to promote* tc»cH bc»r devc^lopment 
The I ompelinj; demand** of educ at ion fr«»- 
queniK pii^sh e\nlu.itinn to a low priorit\ 
sijiu^ 

3 The pro{e<sk(es) for linking staff de- 
velopment and teacher evaluation is (are| 
not clear We lac k a clear goal for forma- 
tive teiH lier e\aluHtion (i e . an image of 
the desired s\stem) and a plan for acliie\ - 
ing that goal State laws and distnc t poli- 
cies .ind procedures do not reflect that 
goal, and individuaK (tearher*^ and ad- 
ministratCfr** alike| in the system have yet 
to provide* the sup|Kirt needed to make 
evaluation results truly productive De- 
npitean important emphasis on pfotpctlng 
tlH» due pro( es« right"- of teacher**, evalu- 
ation s\ stems lac k a similar commitment 
to promolinu profes^ion«il development 

4 Trust in tl^e e\aluHtion s\^tem is 
often Ih( kmu «imong educator'* function* 
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ing in that system Unclear or unacu»pt- 
able performance criteria combined with 
lack of teacher involvement m dexelopin^ 
performance criteria and infrequent an(! 
superficial observations, tend to breed 
skepticism among teachers about the 
value of results The adversarial relation- 
ship between districts and collective bar- 
gaining units also breeds distrust 

Having identified a hst of significant 
barriers, conference participants then 
turned to the task of finding solutions 
Simple solutions were not expected or 
sought Nevertheless, participants gener- 
ated a list of starting points from which to 
begin various assaults on kev barrier** 

Individuals noted that commitment to 
effective teacher evaluation as an impor- 
tant means to school improvement mu**t 
be given prioritv status in the district In 
addition, district staff need to determine 
the foremost purpose of their evalua- 
tion — either staff improvement or person- 
nel decisionmaking — and develop proce- 
dures appropriate to accomplishing thai 
purpose Added to these initial steps, con- 
ference participants called for 

• involvement of all staff in the plan- 
ning process. 

• identification of meaningful and rel- 
evant performance criteria as the ba- 
sis of the evaluation. 

• evaluators trained lo pinpoint teach- 
ers* skills in need of develojiment 

• inclusion of other sources of infor- 
Uiotion about teachers* proficiency, 
including data from pc»ers. self and 
students. 

• cle\ elopment of a comprehensive staff 
de\elopment program for evaluators 
ds well as teachers: and 

• adequate resources — time and 
money — to develop a thorough pro- 
gram of feedback and development 
for staff 

In Search of Solutions 

Teacher evaluation, as the case studies 
and summaries of national teacher eval- 
uation practices Indicate. I? viewed a^ an 
important school-based method for im- 
proving teachers' skills. In practice, how- 
ever, evaluation has substantiallv les^ im- 
pact than IS desired Despite increasing 
empliasi** on improving the qualit\ of 
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tedLhtT i»\dludliun prugrdins nioM •ini- 
pru\rriu'n!v' si i-n Hiri i ti d dt s\ stcindli/- 

dhuuiui Most l."dLlu7 e\dludlion svstenis 
now require regular annudl or bidnnudl 
evdluations. specif) the generdl perform- 
aiuo cnlerid to be usi»d dtfrni* the pro- 
ciHliire^ in \hv uvdludlmn cycle call for 
wnlleii docunienldlioii of results and re- 
quire that those results be formdlU re- 
viewed with tedLhers Some teacher e\dN 
Udtmii progr=^ms have mcieased teachers' 
pdrtuipdiiun tn evdludtion b\ including 
peisondl goal setting and cdrefulU outlin- 
ing pldns for dcroniphshing goals But ed- 
ij( «itors g<'nerdll\ com ur that even bighK 
de\eluptHl e\ iliidtion s\ stems are not 
lu'lping t(•dllu•l^ either ind.\uludll\ or 
{{>lli'{ ti\el\ to inipro\e tlifir skills 

Sunii' of the changes needed lo m.ikt 
exdludlior. more ef(eili\e, from teachers' 
dnd supervisors" perspe(tives dre these 
Tedchers and administrators need to col- 
idhordte on Uie goals, 'en. and proce- 
dures for evdluation. .\alUulion proce- 
dures need to be geared to diagnosing 
teai hers' sVillsand aiding tlieni in making 
instru( tior.al changes. super\isors need 
more Mnie supjuu! and tr^nniii^ to di.ig- 
nose insirut tioiiiil problems at, ' evalud- 
tion method! need to be more soundl\ 
based and linked to rew ards and sanctions 
in the orgdnization 

Persistent problems suggesi thdt sub- 
stantia! changes are needed in tht oiga- 
ni/ation of evaluation s\stenis. in the em- 
phasis guer instructional improvement, 
in the kiiic^ and qualitv of information 
provided teachers, and m the w*d\? ^Vdl- 
Udtion is conducted 

Making the Purpose Clear 
Most teacher evaluation s\ stems have 
attempted to accomplish simultaneousK 
two potentialK conflicting purposes to 
eiKouragc* teacher development and im- 
prove instructional quaht\ (formative) 
dnd to ludge teacher effectiveness and 
acquire evidence of incompetence (sum- 
mative) As a result, most have succeeded 
oiiK margmalU. doing whatever neces- 
sar\ to nieet minimal legal requirements 
In practice summati\e evaluation has 
usuulK taken precedence*, formative ac - 
liMties b\ nature more unu» c onsuniing 
anil demanding ha\e been dealt with su- 



perlu uillv it at dll a consi-qm lu t 
t.\.,!u.uu»ii s\sUm;is haw not proMdr.i 
uijuate (iKignosis cMid dssisldiu e lu supp'-rl 
tidJier inipro\enient Further thedu.il 
purpose of most evdluation programs tins 
increased tension, in man\ instdnies un- 
dermining the trust, honestN. opc*nness. 
and motivation nec^ded to promote exper- 
niie!itation with new teac hing ap- 
proaihes For formative e\aluation tcj 
work niost c^ffectiveU. it needs first to be 
specified as a primary purpose of evalua- 
tion, and second to include appropriate 
procedures for acquiring information 

In the authors' opinion it is both feasi- 
ble and ad\ isable to eniphasi/e formative 
e\ciludtion and to develo|> an cMUiron- 
mrni loiiduiue to its sucjess Although 
Ihis nm\ be dt c omplished in main wa\s 
sU( ( ess ol the ac ti\ it\ appears to hinge on 
d iiumhtr of iniportdnt steps first it de- 
'iiands dll openness to c liangt and com- 
mitment to improvement Teachers and 
super\ isors must agree on priorities shar- 
ing di»i isions on what needs to be accom- 
plished and when Second, it involves co- 
operatneU selecting training opportuni- 
ties deterniiiiing the degree to which oli- 
t<'c li\ es »ire ai c omplished and new skilN 
ledfiied (sideiting c riterid for perlorni- 
ante). incorporating multiple sources of 
information to determine the effect of 
new teac lung approaches oii stuilt»nts and 
sharing resourc es to support changing be- 
ha\ lors In effect, sue cess will require that 
teachers and adininistralors work to- 
gether coopeiativel> . as niutualU suppor- 
tive allies 

Emohasizing teacher development as a 
ma|or purpose of evaluation requires 
strategies different from those commonl) 
used in summative evaluation, as the fol- 
lowing paragraphs show 

Improving the Qualil\ and Availabi/ifV 
of in/ormotion 
Responsibility for summative evalua- 
tion falls most frequently to the school s 
principal or vice-prinopal More often 
than not. once-a-year observation is the 
sole basis for determining teachers' per- 
formance and identifying needed skills In 
formative evaluation, numerous infor- 
mation sources ma\ be tapped Peers, stu- 
dents and teachers tbemsehes ofter a 
broad spectrum of perspectives, thus in- 
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crpa«iinptht'odd<» that slrrrrzlhs and nrcd^ 
Will bp tflcntifird arcuratoK Furthpr. tp- 
spnnsihiliU for formalivp pvahialion ran 
bp pliif chI i]T^\ and forpmosi m Iho hnnds 
of c«i( h trarhpr and cnn pmplo\ relevant, 
useful data from sources, such as students 
and fellow „'achers. who are thoroughlv 
familial with thp classioom environment 
Man\ othrr information resourc p«;. usu- 
allv disregarded in summativp evaluation, 
are appropriate in formative evaluation 
For exdmpip studpnt achievement data 
ran bp useful Although standnrdized 
achievement test data are considered an 
inappropriate basi*; for summative evalu- 
ation. tpd( hprs own da\ -lo-dav cla~«^-ooni 
mpa*>urc*> provide dingno*>ti( information 
thdt nia\ i)p a \ iial component of a teacl»- 
er'*> self-p\aluntion o' instructional 
strength^^ and wpakne*>*>e«i 

Fnsunnp Advqiinti' Pi'rfnrmnnrt' Cnirrm 

The significance of relevant perform- 
ance criteria can scarceK be overstated 
Criteria present stumbling blocks to 
sound assessment if and when the\ (a) 
fo( us on personal chardcteristirs rather 
thrfn instructioUfd ski IK. (b) mil for infer- 
ences ab(>ut tcsu tiinp brhtU lor thdl r nm- 
pronii*»<' relj«ibtlil\ |< I tin- tcio gcnrr.*! to 
pro\i<ir di<»«n(>siu inlorniiition hiuI (d) 
are uncleiU or unrelated to professional 
prarti((»s of tccirhers f(^rmnlive teacher 
e\rihiHtion ( nn be niorr effec ti\e if ihesp 
fa( tors ,\Tv f onsidpred in est.iblishing the 
p('riorm«iii( e c rileria thdt ke\ the proi ess 

first (ritorhj should relate to student 
outc om»s defined .^s important b\ ( urr(*nt 
rese<irrli fUui should be identifiefl (ollab- 
ordtiveK b\ te,ichers an<1 principals The 
emphasis should be on behaviors that 
seem to make a difference, such as the 
clarPv of a teacher's presentations Al- 
though researchers acknowledge that not 
all behavior works m all settings, there is 
growing evidence now that certain in- 
structional methods. <;uf h as tho«ie asso- 
ciated with direct instruction, have im- 
part on student achievement in many 
contexts 

Second, each performance criterion 
should describe some teacher behavior or 
( harnf teristH of the classroom environ- 
ment that car be consistentK evaluated, 
regardless of whvn the evaluation o((urs 
or \N ho observ es the behavior 



Performance Assessment 95 

Third, each criterion should be clenr 
and specific enough to vield diacnostx 
information Ratings that do not sugg»^M 
how performance might be improved are 
of little value to a teacher 

Fourth, each performance factor must 
be endorsed by the teacher as appropriate 
for his or her classroom To merit such 
endorsement, criteria must be (a) valid 
vi'ithin the unique learning environment 
established by the teacher, (b) appropriate 
for the content taught and the instruc- 
tional method(s) used by that teacher, and 
(c) flexible enough to allow the teacher a 
choice of instructional strategies 

Fifth, performance criteria need to be 
practical as well as relevant Though cri- 
teria need to be diagnostic, a long list of 
minuteK specific behaviors that cannot 
be rated, communicated, or addressed in 
a reasonable time is likely to generate 
confusing feedback and planning prob- 
lems. Some balance is needed between 
diagnostic precision and cumbersome de- 
tail If the list of important performance 
criteria grows excessive, evaluators 
should set priorities and address onlv part 
of the list in a given term, semester, or 
vear 

Sixth in reviewing criteria, the tea( her 
and evaluator should identif> relnfive/\ 
weak areas of performance and mutuallv 
design steps to improve those areas More- 
over, in all formative evaluations, it is 
inappropriate to compare one teacher's 
performance with that of another for the 
purpose of ranking teachers b\ profi- 
riencv The uniqueness of learning envi- 
ronments student groups, instructional 
stvles. and teacher groups make such 
comparisons meaningless In addition, us- 
ing teacher norms or rankings invariably 
promotes a dcfensiveness that is counter- 
productive. After all. professional devel- 
opment. not criticism for its own sake, is 
the whole point of the svstem 

Finally, all desirable change depends on 
establishment of effective channels of 
communication between teacher and su- 
pervisor. For many teachers, evaluation 
results have not been communicated 
either constructively or diagnostically As 
one educator commented, '^fault finding 
without suggestions for remedv. categori- 
zations (e.g. good, average) that provide 
little diagnostic assistance, generalities 
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Ihdl dppcdr to htu V U\\\v idC\u<\\ bdsis diul 
ri'purts thdi mAc n. t Nmt ( uJV:\h Mdu to 
or^anizdliondl godN" art' nut ullfCtiM* 
forms ot cornmunication (Bollon. [) 
148) This is true of course, for oilhcr 
furnid!i\ V or sunimdiive evaludlion 

Useful evaluation results promote in- 
structional awareness and prompt 
changr To do so. presentation of feedbd( k 
should oc( ur in dn atmosphere of mutudi 
problem solving and trust, teachers need 
evidence that their efforts toward profes- 
sional growth will be rewarded with per- 
soiidl recognition and support As Darling- 
Hammond ti al (1983) stdte. *'Effertively 
changing the behavior of another person 
requires enlisting the cooperdlion and 
motUdtuiii of tiid! [)i'rson in dcidiliou to 
pro\idin^ guuldiKc on llu' steps net^dt'd 
tor improvement lo occur" (p 314) 

EUvi u\t Forthatwr Evdluiiimn 

Assessing tedchers* performance is dn 
iniportdnt task It is hoped that the fore- 
going discussion will promote better un- 
derstanding of effective evdluation prac- 
tice while at the same time encourdging 
educators to attempt diternative. dynamu 
approd(ties to the fornidtue e\dludtion 
process Those alternatives (an work lo 
improve instrurtion if the lollowing 
guidelines dre observed 

• Select methods to match e\dludtion 
purpose The purpose of dii evalua- 
tion sNstem must bv clearK identified 
and understood in order to select ap- 
propriate methods The same proce- 
dures cannot construe tivel\ and si- 
multaneousK ser\e the needs of 
♦hose interested in promoting teacher 
development and those responsible 
for personnel decisions Both sets of 
needs are important But different 
methods are needed to address differ- 
ent purposes 

• Involve teachers in evaluation 
Teachers should be involved in nil 
phases of developmg and operating 
formative systems An\ evaluation 
program that does not reflect the in- 
terests, concerns, aspirations, and 
needs of teachers is doomed to failure 
B\ the same token teachers must 
have constructive attitudes to make 
the sNsteni work Teaching must be 



regarded ds a skill to be I.Mrned and 
partiup.int'- niusl be willing man- 
agers ol their ow n de\ elopment 
read\ to consider, explore, and prac- 
tu e new teaching skills 

• Provide relevant training All evalu- 
alors and staff must be thoroughl\ 
trained Everyone involved in the 
evaluation should know how to use 
e .aluation instruments to acquire 
useful, objective data, interpret re- 
sults, and use those results to advan- 
tage Similarly, evaluators should be 
trained to provide feedback to teach- 
ers that IS clear, preci^t' and suffi- 
cient!) diagnostic to promote realistic 
plans tor improvement 

• liK rease sources of e\ aluation data 
Thorough formative evdiudtion 
should include the perspectives of 
students, peers, teachers themseKes, 
and supervisors, and should incorpo- 
rdte several kinds of observdtion. not 
)ust once-a-year classroom spot 
checks 

• Use meaningful criteria Performance 
criteria must be relevdnt to desired 
student outcomes, specific enough to 
be Useful in planning professional de- 
velopment, and accepted as impor- 
tdnt b\ edch teacher to whom the\ 
will apply 

• Relate results to organizational goals 
Evaluation results should be used b\ 
both teachers and staff development 
planners to set training {)riorities and 
to evaluate success in achieving or- 
ganizational and personal goals Suc- 
cessful evaluation is clearK tied to 
organizational planning Moreover, 
the system itself should be evaluated 
regularly before any procedures be- 
come so firmly entrenched that they 
are unresponsive to change 

The entire framework of this proposal 
for formative evaluation rests on one 
overriding ' amption School managers 
and teachers alike function best in an 
environment characterized by mutual 
support, by respect and concern for per- 
sonal growth and for the well-being of 
staff and students Where such an envi- 
ronment exists. format!ve teacher evalu- 
ation offers great potential for helping 
teac hers learn lo teach better 
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Ciuen riirrent ec oni^mu condition*^ niifi 
delinking ci'.rollmrnls frwrr nf'w t<, ich- 
ors are entering thr prnfrs^^ion Thorrfore. 
improving thr qualitv of inMrurluin do- 
mand«; developing the skilK of teachers 
alread\ in the classroom Formative eval- 
uation— a s\stem inherentK sensitive to 
teac hers needs and goals— can be a vital 
slop in strengther. .g instructional effec- 
tiveness nationwide 
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Commentary on the Role of Student Achievement Data 
in the Evaluation of Teachers 

While teacher evaluations typically are based on the observation and 
rating of teacher performance in the classroom, there is a constant 
undercurrent of interest in evaluating teachers based on the achievement of 
their students. This interest often focuses on the use of norm-referenced 
standardized achievement test scores as the index of student learning and 
therefore of teacher performance. However, both Haertel (1986) and Berk 
(1988) have spelled out in precise detail why this summative teacher 
evaluation use of standardized test scores is indefensible from both 
assessment and evaluation perspectives. The reasons rest principally on the 
insensitivity of the assessment instruments to the effects of particular 
teachers and the long list of factors that are beyond the control of the 
teacher that influence the scores. Haertel dispells common misconceptions 
about the role of such test scores in teacher evaluation and chen outlines the 
complex and demanding set of steps local districts must complete in order to 
develop standardized assessments that will be sensitive to individual teacher 
effects. While such test development programs are feasible, few districts 
seem willing to hire the measurement expertise or allocate the resources 
needed to carry out those steps successfully. 

This leaves us on the horns of a dilemma. On one hand, we believe that 
one legitimate source of evidence of the effectiveness of teacher performance 
should be whether or not students are learning. We feel certain that if 
teachers are held accountable for student achievement, then teacher and 
student performance will improve. Yet, on the other hand, the one index of 
achievement that we always thought we could count on— standardized achievement 
test batteries — cannot and will not do the job. 



Do we conclude therefore that there is no role for student achievement 
data in teacher evaluation? Definitely not. I believe there is a clear and 
appropriate .ole. But for reasons outlined below, we have a great deal of 
work to do if we wish to take advantage of it. In order to understand that 
role, we must face our real aspirations for students. First, we must decide 
if we really care if students learn or not. Then we must act decisively to 
make hioh-guality assessment of student learning an integral part of the 
teaching/ learning process. 

Do we care about learning . . . really ? 

While our interest in evaluating teachers in terms of student learning 
appears to stem from a desire to concentrate teacher efforts on promoting 
student academic achievement, there is considerable evidence available to 
suggest that, indeed, we do not really care if students learn at all. Before 
proceeding, let me hasten to add that I know educators care very much about 
students achievement. But just tor a moment, consider some evidence to the 
contrary. 

If we cared about student achievement, would we not go to great lengths to 
be sure eac^ and every teacher is ready and able to assess that achievement in 
the classroom on c day to day basis, so they would know how to monitor and 
could adjust instruction to maximize learning? In fact, we rarely offer 
teachers the assessment training needed to do so. Schafer & Lissitz (1987) 
have shown us that most teachers are not required to complete any assessment 
training whatever in ord. to graduate from teacher training programs or in 
order to bo certified to practice their profession. Many are not even offered 
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the option of participating in such training. Further, those who are trained 
typically are inadequately prepared with respect to assessment concepts and 
procedures needed to address the ongoing assessment demands of the classroom 
(Gullickson, 1986). Does this sound like a profession that cares if learning 
is occurring? How can we argue that we care, when so few practitioners are 
trained to determine if learning occurs? 

And when we examine the professional preparation of administrators with 
respect to the assessment o£ i5tudent achievement, we see an even more 
troubling picture. The vast majority of administrator training and 
certificate programs offer no training in assessment at all (Schafer & 
Lissitz, 1987). This often leaves principals less well-equipped to address 
assessment issues of those teachers whose work they are to supervise. Many 
simply cannot evaluate assessments and therefore do not know if sound 
assessments are being used in their classrooms. Many admininstrators are so 
ill-prepared to address matters related to the assessment of student 
achievement that they do not understand why it is indefensible to use 
norm-referenced standardized tsst scores to evaluate teachers. Does a 
profession that cares about learning not prepare its leaders to verify that 
learning is, in fact, occurring? 

There is more. Would a profession that really cared not impose standards 
for high-quality assessment on those who develop the tests that accompany 
published textbooks and other curriculum materials? Such stanacsrds exist for 
standardized test batteries. But no such standards exist for text-embedded 
tests and the effect often is obvious in terms of the quality of these 
assessments . 
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Would a profession that cared about student learning not have long since 
thoroughly researched the nature of the classroom assessment environment so as 
to translate the results into relevant and helpful training for its 
practitioners? That research and development effort is only now getting 
underway and is being conducted in just a verr few places. It is literally in 
its infancy. So far. the measurement community knows little about the task 
demands of classroom assessment (Stiggins. Conklin & Bridgeford. 1986; 
Natriello. 1987). How can we argue that we care about student learning when 
we don't under stano it's assessment in the classroom? 

Finally, would a profession that really cared about outcomes not have 
systematically trained its policy makers (schoolboard members, state 
department personnel, state legislators, federal policy makers, etc.) to 
understand and use assessment data in an informed and appropriate manner? 
Such understanding is rare indeed. 

However, with all of this having been said, my point is no*;^ that we don't 
care about learning. Of course we care! The point is that we spend all 
available resources training teachers and admininstrator s to produce learning, 
put that training to work in schools, and then allocate no resources to train 
practitioners in the methods of assessing the outcomes of their efforts. Then 
when the crunch time comes, such as when the public demands that teachers be 
evaluated based on student learning, we naively look for the easiest possible 
way out by unquestioningly using standardized norm-referenced test 
scores— assessments that cannot work in the teacher evaluation context— as 
evidence of teacher effectiveness. The point is that most educators on the 
firing line have not been trained to generate and implement alternative 
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strategies for bringing student achievement data into the teacher evaluation 
equation. In my opinion, we have not yet begun to pay the dues we owe in the 
form of the commitment, training and resources needed to develop the 
assessment expertise or sound instrumentation required at the school building 
level to assess student learning and evaluate the impact of teachers on that 
learning. 

Taking a New Look From a Different Perspective 

We can bring student achievement data to bear in the teacher evaluation 
context if we simultaneously change our perspectives in two important ways. 

First, when we regard the teacher evaluation process, there is a pervasive 
tendency to think only of the summative side of the evaluation equation. Even 
Berk and Haertel took this perspective in their very thorough discussions of 
the role of student achievement data in teacher evaluation. But Duke and I 
(Duke & Stiggins, 1986) have suggested that we can do a great deal more to 
improve the effectiveness of teachers and schools if we begin to regard 
teacher evaluation as growth-producing events. Student achievement data can 
play a much more significant role in the teacher evaluation equation if we 
make this shift. The specific reasons are spelled out below. 

Second, we must shift the focus of our consideration of achievement data 
in teacher evaluation away from test results derived from centralized, 
standardized testiag programs and toward results derived from teachers* 
classroom assessmerts of student achievement. If we help teachers to use 
high-quality classroom-level achievement information to determine if their 
instruction is working, then we take a major step toward helping these 
teachers tap student achievement data as one source of the informaton needed 
to estiiblish and achieve their own important professional development goals. 
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Let* s consider these two proposed changes in perspective in greater detail. 
Forus on formative . We gain a major advantage in improving the impact of 
teacher evaluation if we use evaluation formacively rather than summatively . 

Summative evaluation serves the screening function of identifying those 
few teachers who have failed to attain minimal teaching competence. These 
teachers must be retrained and improve or leave, and resources are brought to 
bear to determine which will happen. Certainly, ^his is a very important and 
useful form of teacher evaluation. But we often lose sight of the fact that 
this process typically impacts very few teachers-by design. We seek to 
eliminate incompetence. But by and large, we do not have a great deal of 
incompetence to eliminate. Nearly all teachers are at least minimally 
competent. Thus, for the vast majority of teachers, repeated and continuous 
summative evaluation typically has no impact. They continually demonstrate 
their competence and uothing changes. 

Formative evaluation, on the other hand, can achieve a much broader 
impact. The objective of evaluation in this case is to help each individual 
teacher identify professional development goals that are uniquely relevant to 
them. Since all teachers can grow in some important ways, formative 
evaluation offers the potential of helpino large numbers of teachers to become 
more effective. 

If we seek to use student achievement data to improve schools through 
effective teacher evaluation, the critical question we must ask is this: 
Given extremely limited resources for teacher evaluation, do we gain more 
school improvement per unit of resources invested by (a) usiug student 
achievement data to weed out the very few incompetents, or (b) using that data 
to help all teachers see in clear and unequivocal te..ns how they might become 
better teachers? Why not do both, you might ask? We can do that. But then 
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we confront the heart of the matter: How should we apportion ^ur extremely 
limited teacher evaluation resources between the two? Which ^ill provide the 
biggest school improvement bang for our buck? I think the answ - is obvious. 
Resources devoted to helping teachers use assessment data to'improve teaching 
hold much greater potential for school improvement than do Resources spent for 
standardized testing for summative purposes. Yet resources rarely are 
invested in this way. More about that later. 

Focus on classroom assessment . As mentioned above, inherent limitations 
in norm-referenced standardized test scores make them inappropriate tools in 
the evaluation of teacher performance. They lack the p^wer needed to provide 
indepth information on student learning over a sufficiently long period of 
time and under sufficiently controlled conditions to permit cue establishment 
of causal links between teacher performance and that learning. But as luck 
would have it, we appear to have an excellent alternative at our disposal. 
Teachers measure student achievement continuously in their classrooms. Why 
not use these classroom measurements of student learning as a tool to evaluate 
teachers? 

On the surface this sounds feasible. But one frequently cited argument 
against the idea is that ast »nts across various classrooms are not 
comparable. They are unique to each classroom. How can we compare teachers 
across classrooms using different measures? We need standardized outcome 
measures . 

This is specious argument that reveals precisely where our thinking has 
become confused about the real differences between formative and summative 
evaluation and the role of student achievement odta. The very strength of 
standardized tests is their comparability. But if our goal is to help each 
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individual teacher to identify her or his own relevant professional 
development goals through analysis of how well their own students are 
learning, why must the student achievement data used in this process be like 
the data gathered by any other teacher? There is no reason. No teacher to 
teacher comparison is needed. Ther-i is no requirement of comparabil * ty of 
achievement data in the formative teacher evaluation context. 

The price we pay for trying to force comparability of achievement data 
into the teacher evaluation context by usin', standardized test scores is the 
loss of sensitivity of the data to individual reacher effects. Formative 
evaluation requires only data that are valid and reliable in terms of the 
objectives the teacher intends for her or his students to master. For 
personal professional growth purposes, it matters not how other teachers' 
students achieve. 

So for formative evaluation purposes, it appears that the oest index of 
student learning is classroom assessment results. Under ideal circumstances, 
there is no question that this would be the case. But unfortunately, this 
brings us to another dilemma: we cannot encourage teachers to use their own 
student achievement dcta to determine how t5 improve their teaching because 
their assessments often are undependable (Stiggins. Conklin & Bridgeford. 
1986. and Natriello. 1987). Typicall: . these are assessments developed by 
practitioners untrained in assessment methodology who aAnit to concern about 
thr quality of their assessments (Stiggins & Bridgeford. 198S). We know what 
they need to learn about assessment processes and we know how to teach them to 
assess effectively (Stiggins. 1987). But the point is that most teachers have 
not participated in this training. Therefore, if we wish to use student 
achievement data for formative teacher evaluation, we must first lay the 
foundation with effective assessment training. 
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Teachers use many different forms of assessment in their classrooms on a 

day to day basis: 

o Teacher-developed paper and pencil tests and quizzes, 
o Tests and quizzes that accompany textbooks, 

o Assessments based on observations of and judgments about 
achievement-related ',ehavior, 

o Assessments based on observations of achievement-related products, 
o Homework zz<i seatwork assignments, 

o Oral questions posed during recitation and in interviews and 
conferences, 

o Student self and peer assessment, 

o Group assessment activities, and 

o Opinions of others, such as other teachers and parents. 

Each of these options represents an excellent source of information for 
teachers regarding the achievement of their students, if developed and used 
well. Often they are not. Teachers need to know how to be sure each form is 
providing dependable data on student achievement, and they need to know how 
and when to make corrections when standards of dependability are not being 
met. Most are not trained to do so. 

As I review the above list of assessment method options, I am struck by 
the exciting varieties of student achievement we can assess if we use this 
full range of options effectively. Note the extreme contrast between the rich 
definitions of achievement we can derive from this array of options compared 
to the very narrow definition of achievement we can derive from the 
multiple-choice format of the norm-referenced standardized test. Consider the 
potential of classroom assessment to provide the teacher with a continuous 
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flow of data on student learning, sc that teachers can make timely adjustments 
to maximize effectiveness, in cortrast to the once-a-year data of the 
standardized test. Consider also l" " much teachers can learn about their own 
effectiveness and improvement needs based on the results of good-quality, 
continuous classroom assessment compared to how little they can learn from 
once-a-year standardized tests. 

But again, you might ask. why not use both classroom assessment and 
standardized test data to help us make important decisions? With some notable 
exceptions. I think we can do that. One such exception is teacher 
evaluation. Both Berk and Haertel have shown us that norm-referenced 
standardized test scores were not designed for this purpose and cannot serve 
well in this decision context. That is not to say that such test scores 
cannot serve many other valuable purposes. Certainly they can. 

However, here again, we must face the same kind of critical question 
raised earlier about the relative value of formative and summative teacher 
evaluation: Given limited resources to spend on assessment (in this case, in 
the context of teacher evaluation), do we gain more school improvement (a) by 
developing and implementing more centralized standardized testing programs, or 
(b) by training each teacher to assess student achievement effectively and 
efficiently in the classroom on an ongoing basis? And if we decide to do 
both, how shall we apportion those limited resources betweer the two? Which 
returns to us the most school improvement for our assessment dollar? Once 
again. I think the answer is obvious. We need to train teachers to generate 
their own valid, reliable data with confidence. But we currently are spending 
all available assessment resources on the former and virtually nothing on the 
latter. 
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The Bottom Line 

Some teachers are evaluated in some districts on the basis of standardized 
student achievement performance of students. Often, norm- referenced 
standardized test scores are examined. This is done in the service of 
promoting school improvement by identifying less-than-competent teachers. 
While the goal is important, this use of test scores does not represent sound 
assessment or evaluation practice. 

We have far better options at our disposal. First, we can strive for a 
more defensible balance in the allocation of resources between formative and 
summative teacher evaluation, so as to provide the most support to the option 
that holds the most promise for helping the largest nuirber of teacher 
improvements. Second, we can strive for a nore defensible balance in the 
allocation of resources between generating standardized test scores and 
training teachers and instructional leaders to assess well in the classroom on 
a daily basis, so as to provide the greatest support to the option that holds 
the greatest promise for helping the most teachers improve. 

In my opinion, both resource allocations have been and continue to be 
grossly out of balance favoring the option with the least potential impact. 
It need not be so. Used together, formative teacher evaluation and dependable 
data on student achievement can represent an unbeatable combination for school 
improvement. But we must be prepared to invest the resources needed to build 
such a powerful team. 

Changing Direction 

A wide variety of very specific actions can be undertaken at once to move 
us toward a proper balance. For instance, we can design teacher evaluation 
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environments to be sure the evaluation experiences of teachers reflect those 
attributes that maximize the chances that teachers will benefit from the 
experience. Those attributes are known to us and are well within our reach 
(Duke & Stiggins, 198C). In addition, however, it is as important that we 
begin at once to move uS rapidly as possible toward a time when the assessment 
of student achievement has been "demystified" for all--toward a time when 
everyone who has a vested interest in schools, students and learning has come 
to be both comfortable and competent with respect to the basics of measuring 
achievement. By everyone. I mean the public, policy makers, administrators, 
teachers, students and parents. If we are to reach this goal, many must 
contribute. 

The educational measurement community mu^t remove the shrouds of technical 
complexity from its instruments and procedures. Guidelines for the proper 
development and use of all types of classroom assessment must cast in terms 
the practitioner can understand and use. Then those basic assessment concepts 
must be translated into training programs that integrate assessment inco 
instruction-i.e.. training prog r ^^s that are relevant to the teacher in the 
classroom . Training methods must fit into preservice and inservice training 
contexts, but primari y the latter. Then teacher and administrator training 
and certification requirements must be amended to reflect the importance of 
assessment to effective instruction (and thus teacher evaluation) and 
resources must be allocated to provide the training. This will take 
assertive, collective action at state department, post-secondary, local 
district, building and classroom levels. 
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Much already has been accomplished, but there is much more to be done. We 
are gaining a clear sense of the basic measurement tools teachers need to have 
at their disposal (Stiggins, Conklin, Bridgeford, Green & Brody, in press). 
Further, we are beginning to understand how to make classroom assessment 
training work for teachers. Now we need to find the most efficient and 
economical ways to deliver needed training. I urge that those resources be 
obtained in part by redistributing soine of the resources allocated for 
summative teacher evaluation systems to formative systems, and by transferring 
at least some of the considerable resources spent on standardized testing to 
the improvement of classroom assessment. Let the proportional distribution of 
resources reflect the potential for each expenditure to improve schools and 
student learning. Currently they do not. 
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TEACHER EVALUATION PROFILE 
USER'S GUIDE 



-Ms guide introduces the Teacher Evaluation Profile, or TEP, to those 
who plan to use it. The TFP is a data collection instrun.ent and 
reporting systen that allows users to document the nature of the teacher 
evaluation environjT,ent in a particular school or district. The 
instrun^ent and reporting system have been developed from « P^°g^»" °^ 
research at the Northwest Regional Educational Laboratory (NWREL) that 
identified the important attributes of a specific kind of teacher 
evaluation envi ronment-that is. an enviroament that promotes the 
professional development of teachers. Thus, information derived from 
a^,in!straticn of the TEP allows the user to analyze the growth-producing 
potential of a particular teacher evaluation environment. 

II t^s guide, we review the research origins of the TEP. present a 
detailed description of it, discuss its various "''•'''./"^y" , ^ 

° ,.-v._e" ' c-.a-acteristics of the instrument, provide directions for 
TEP «d.in;;tration, explain how to interpret TEP results, and illustrate 
how ;:hose results can be used to enf.ance the growth-producing quality of 
local teacher evaluation systems. 



THF ORIGINS OF THE TIP 



we know that things grow when conditions ere right to P^°;°^« ^^^^ 
growth. Growth takes place when the growing mediun, is appropriate, the 
growing organism is healthy, and the proper nutrients are provided over a 
sufficient period of time. This equation holds for all living, growing 
"gli ms, and it applies to psychological as well as biological growth. 



If practicing teachers are to grow in professional competence, ^he school 
environment must be appropriate, the teacher must be open to and ready to 
grow, and sufficient resources and activities must »»• P'^-^;;^ • 
sufficient period of time to stimulate and encourage that growth. The 
teacher evaluation process has the potential of promoting 9"«th. Data 
can be gathered to suggest needed improvements, growth goals can »>• "t, 
r«oSrces can be brought to bear to promote professional development, end 
the evaluation process can provide feedback that stimulates and 
encourages professional development. 

unfortunately, there is much research to document the fact ^hat teachers 
a?mo never'derive any professional improvement '"J^f " J» ^^P^^'" 
in the evaluation process (Stiggins t Bridegford. 1985). f 
leading to the development of the TEP began with an attempt to discover 
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whv this the case. That research included three studies and is 
deU ii d1n g eat detail elsewhere (St.ggins & Duke. 1988) and so xt 
w!!l not be reviewed in depth here. But a brief sunur.ary v.ll help to set 
the stage for tne effective use of the TEP. 

STUDY I The first study in the three-study sequence leading to the 
g^;e.f of the TEP began w.th an indepth study of the teacher 
•valuation svstems in four school districts. The goal of the 
W ;°ti ' wirto uncover barriers to teacher growth through effective 
Tatuat^on. Indepth irterviews with teachers and supervisors, as well as 
responses to questionnaires, revealed that both teachers and 
I^fni trators were able to cite critical weaknesses in the -alu^t.on 
environment and mechanisms that were detrimental tc teacher g^^th. 
Mter reviewing the results of the studies of their four ""trxcts and 
discussing the issues, both teachers and supervisors agreed that the 
ma oJ b«?ier to teacher development in the present evaluation systems 
we e lack of training among participants in effective evaluation 

Tnd feedback procedures, (2) insufficient time available or «ll°"ted for 
evaluation (3) a lack of trust in each other among teachers and their 

" " . L (4) the complete domination of the •-^"f-" P""" ''^ 
concerns for due process rights and evaluation for accountability 
concerns tc the exclusion of concerns for teacher growth. 

cTimv 2 Since it was not possible for the researchers to assume 
fS^f^^fibi ty fo a district evaluation system, remove the barriers and 
inuio^e teacher growth resulted, the second study in the sequence 
exam ned eacher growth from a different perspective. This nvestigation 
so^^it cu a d focused on teachers who reported that they had experienced 
v«y important professional growth as a result of a high-quality 
I!Iluatior experience. While only about thirty such cases could be 
!deiu ed for udy, the researchers were able to examine and describe 
each iae in great depth for comparative analysis. The comparison of 
cases "s onducted to discover if these instances of successful, 
g"wth-p oducing evaluation had any important ingredients in commo.. If 
^o::on elements'were found-elements that n^m^ted he 

barriers found in study one-then perhaps conditions that promoted the 
growth for a few could be replicated elsewhere to promote the growth of 
many. 

Tn fact a wide variety of common elements were found. There were 

em n s ^ha^ Uachers^rought to the evaluation event that contribu ed 
to the positive results of the experience. There were attributes tha . 
t°. eva?uator brought to the event that contributed to success. The 
'p!.f7fr ;7^edures used to collect performance data also seemed to be 
related t o" a positi ve outcome of the evaluation, a. did «P«"J^ = 
"i^Icteristics of the feedback delivered to the teacher. And na ly, 
tSrjeneral context within which the event took place appeared critical 
to i?s succelTT^us, attributes of these five components were 
den f" a keys to effective, growth-producing teacher .valuation: 
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the teacher, the evaluator, data collection procedures, the feedback, and 
the evaluation context. 

STUDY 3 The third study in the sequence asked if the attributes 
uncovered in the few cases of successful evaluation *ere related to the 
differential growth e«periences of the general teacher population. Among 
teachers who experienced little or no growth as a result of a particular 
evaluation event, w#re the key attributes missing? Among those who 
eiperienced moderate growth, were attributes present in moderation? Do 
other teachers not involved in the original study who e«perience 
important growth report the key attributes to be part of their experience. 

To answer these questions, a questionnaire was developed which allowed 
400 teachers to describe their recent evaluation experiences m terms of 
the apparent keys to success. First, that questionnaire asked teachers 
to rate the overall quality and impact of their i«ost recent evaluation 
experience. Then it asked them to describe nine specific aspects of 
themselves as teachers, such as the strength of their expectation of 
themselves and their orientation to risk taking and change. These were 
attributes that seemed important in the succe.s£-l cases studied m the 
previous investigation. 

Next, the teachers were asked to describe thei perceptions of the person 
who evaluated theii performance, in terms of their credibility as a 
source of feedback on teaching, interpersonal manner and knowledge of the 
technical aspects of teaching. Additional questions solicited 
information of evaluation procedures (treatment of standards, sources of 
performamce information tapped, etc.), feedback provided (nature and 
frequency, etc.), and the evaluation context (intended role of 
evaluation, time spent evaluating, and policies governing evaluation). 
Over 50 descriptive scales were included in the instrument. 

Analysis of the responses revealed that 44 of the original scales 
combined to create an internally consistent picture of teacher evaluation 
practices that provided a fairly accurate prediction of the overall 
quality and impact of those practices. More specific technical data on 
these points is presented below. For now, however, it is sufficient to 
say the result of this comprehensive study confirmed that the first study 
had resulted in the identification of keys to a growth-producing teacher 
evaluation. The questionnaire used in the third study has been revised 
and lefined to become the Teacher Evaluation Profile. 

DESCRIPTIOH OF THE TEP 

When the research nad been completed, the resulting questionnaire was 
.Jministered to a series of pilot test districts and procedures were 
developed for summarising and reporting results to district decision 
makers in an understandable and useable fashion. In this section, both 
the questionnaire and reporting system are described. 
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w ^„-.e*.i«««jiirft beains by asking the respondent to 

experier.:e ; 

1^^^ ¥{mM. vou were evaluated; that is, your 
Ple.se "^^/^^^ ^a^h^r evaluation syste.. Regard 

^^^^ ^^""^ experience with y planning for evaluation, 

the entire evaluation P"^«"' ^^^J""" J„„ think about this 
classroo. observations and eedback As Y 

::^.!ui:irn; ^SreTica^r/rro": ^ .ith 3 representing very poor 
quality and 9 very high quality. 

.m imnart of vour last evaluation eiperience on 

process. A low "^ing or " understanding, 
changes in your practices, attituoes 

f- ease of data analysis and s,unir,ary, these ratings anu all 
o^hrr res;c:.;es conected on^ .achine-scanable response sheet. 

. ^.a^^ t-e process of describing their evaluation experience 
irt:::rof\ore .ey ':t^nbrt:s that they b.ought to the event: 



Strength of professional expectations of yourself 

Orientation to risk taking 
Orientation to change 



orientation to experimentation in classroom 



• Openness to criticism 
. Knowledge of technical aspects of teaching 

• Knowledge of subject matter 

• Years of teaching experience r.c.nt 
I Experience with teacher evaluation prior to most recent 

experience 



next, the teachers describe the person who conducted the most recent 
evaluation of their performance, in terms of: 



• Credibility as a source of feedback 
« Working relationship with you 

« Level of trust 

« Interpersonal manner 

• Temperament 

• Flexibility 
Knowledqe of technical aspects of teaching 
J«li!Jy to demonstrate or model needed improvements 
Familiarity with your particular classroom 
Experience with classrooms in general 
usefulness of suggestions for improvements 
Persuasiveness of rationale for suggestions 
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The teachers then describe the specific procedures used during the 
evaluation t 

1 VVhat procedures were used to address the <»i"';"»°"^ °' ^^"^ 
teaching (standards or criteria) to be evaluated? 

* Were standards communicated to you? 

: :::: :rand"d: ::":srd 7U appropriate .or .our 
. Sin^rstandards the s^e for all teachers? 

2. TO what extent were the following sources of performance 
information tapped as part of the evaluation? 

Observation of your classroom performance 
: Exa^Inttion of classroom or school records (lesson plans, 

etc.) 

, Examination of student achievement 

3. Extent of observation in your classroom, based on your most 
recent experience: 

M n,h.r of FORMAL ( pr escheduled ) observations per year 
: "SfoL^ltl <^^«"cy of IHFORHAL ,„n.nnou„=.^ .rop-.n, 
observations 

Then a series of inquiries focuses on the teachers' perceptions of the 
feedback they received, including: 

Anount of information received 
Frequency of formal feedback 
Frequency of informal feedback 

Depth of information provided . • th, feedback 

Quality of the ideas and suggestions contained in the feedback 
Specificity of information provided 
Nature of information provided 

?::ibLrf":s:rrd?strict teaching standards 

And finally, the respondents a.e asked to describe the content within 
which the evaluation took place, focusing on: 

. Amount of time spent on the evaluation process including your 
time and that of all other participants 

Resources available for professional development: 

. Time allotted during the teaching day for professional 

. TatlrbUity Of training programs and models of good practice 
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District values and policies in evaluation: 



• Clarity of policy statements regarding purpose for evaluation 

• Intended role of evaluation 

Teachers describe each of the 44 key attributes of their evaluation 
experience by registering their response on a 5-point descriptive scale 
provided on the form. Each item is accompanied by its o%fn unique rating 
scale. For example, respondents describe their perceptions of the 
credibility of the person who evaluated their performance on a scale 
ranging from "not credible" to "very credible." while they rate the 
frequency of the feedback they received from "infrequent" to "frequent." 
Please refer to the complete version of the TEP questionnaire in the 
appendix for more exanples. 

The reporting system design for the TEP collects the responses of all 
teachers in a given school or district and portrays them in three forms: 
a frequency distribution, a graphic profile of average responses, and a 
CO' elationa: analysis. These data are used to generate a narrative? 
report for the user, interpreting results and recommending possible areas 
for improverr.ent . 

The frequency distribution report summarizes the percent of all 
respondents selecting each response option for each item on the 
questionnaire. These data are reported simultaneously for the user 
district and the entire population of several thousand teachers who have 
previously coi^pleted the questionnaire. This allows each user to compare 
results with a much larger sample of responses and to analyse the pattern 
of responses across the range of options. Illustrations of this and the 
other reports are provided in a later section on interpreting results. 

The graphic representation of results charts the district's average 
response on the 5-point scale of each item on a graph chat also includes 
the average response of the total teacher population to date and the 
highest and lowest district averages to use the TEP to date. This 
summary provides additional normative data to use in interpreting 
results. The user can see at a glance where their average ratings were 
above and below the larger sample, and they can detect items rated 
relatively high and low within their own particular set of ratings. 

The correlational analysis examines the relationship between the 
teachers' ratings of each of the 44 individual it«ms and their ratings of 
the overall quality and impact of their most r«c«nt evaluation 
experience. With these data, users can identify those individual items 
that are most highly correlated with positive impact and quality in their 
own unique evaluation environment. Highly correlated ^ems vary greatly 
from district to district and represent a possible starting point for 
adjusting the evaluation system, as positive adjustments in the areas 
covered by t"-«»se items are most likely to be associated with higher 
quality and greater impact. 
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Knowma which items are rrost correlated with high imnact and quality is 
,ost S;iofal when that information is combined with the graphic profile 
o' 'e-a ts, which highlights those items that are relatively low for a 
dls't'ict compared t. responses to all items for that district. The 
decision iT^^^er's objective is to identify those items that are both (1) 
rl'*^-ve' • an3 ( 2> predictive of impact and quality. They have the 
areates-"pot»ntial for change with a positive result in terms of teacher 

Fo' this reason, each TEP user is provided with a narrative 
solT.ary'of results identifying all such items and reconunending action. 

USES OF THE TEP 

Th.. TEP is recommended for use in school districts interested in 
L':i^zi; Th^ growth-producing potential t^a" °er 

e-.v'onment. As SJOh, TEP results have implications for both teacher 
r »nA oractice. In addition, results have obvious 

" Jionrf^ran'who'Sa^ra vested interest in the quality and impact 
of the teacher evaluation process: teachers, supervisors and 
d^s^ri^t-level administrators. For these reasons, virtually all recent 
resea-ch and development on teacher evaluation leads to the 

coLndation that district policies and practices be reviewed revised 
and implemented by means of a collaborative effort ^^"5 
■nt-ested parties. We agree with this perspectiv and STRON.^Y 
nr%.ll^ THAT TEP RESULTS BE GATHERED. INTERPRETED AND USED A 

dYst^iIt^a-her evaluation action committee consisting of teachers, 
pp^v-^pl-f iS^iSTfiicr-LrvEL administrators working as a teak to 

I^iy^ THE r^ACHsf "marriO. ENVIRONMENT IN ^^^TsEhOoTbUEdING AND 

THE ZISTRIZT AS A WHOLE. 

used m th.s wav TEP results can serve three specific purposes: 
d aqno=:s, proq;am evaluation. ,nd research. They can help to diagnose 
Specific diLnsions of the environnent that might be Profit.b y changed 
L imo ove the environment. As mentioned above, results Jighligh which 
of the 44 Items in the orofile are both relatively low 'jd predictive of 
q. alitv and impact for that particular district Given this Kind of 
information, a teacher evaluation planning committee can plan a c^urje of 
action based on results that has the potential of improving the teacher 
evaluation environment in their o^n schools. 

TEP results also can l.elp the user to evaluate the J^f^^ °f ^^^^ . 
interventions intended to change the teacher •valuat.^on 
nstance, if TEP results reveal relative low regard cf 
ieacJers and the district institutes a program of training for 
su^Jjisors designed to enhance the teacher.' P^^^PJ ^j:* °f ,f 
su^rvisors as credible, trustworthy, etc. «>urce. f^^^J^^^ °" . ^ 
J^Hormance, then a successful program over a P«^/°f ^^/^J* '^"^J ^ 
Hflected in the results of subsequent readmi ni.tr ations of the TCP. 
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Siirila-ly. the TEP can serve the district as a research tool of a more 
genera' variety. Profiles can be used as dependent measures to compare 
schools grade levels, different intervention programs designed to 
improve'evaluation. and other multi-level independent variables of 
interest to district and school level decision makers, as well as 
university-based researchers. 



TECHNICAL CHARACTERISTICS OF THE TEP 

The technical or psychometric quality of the TEP data collection 
instrument is reflected in its validity, reliability, sensitivity, 
communication value, and economy of use. Each of these indicators of 
quality is addressed in this section. 

VALIDir . An assessment instrument is valid to the extent that it 
provides an accurate representation of the attribute it is intended to 
measure The TEP is intended to provide an accurate picture of some of 
the key dimensions of the teacher evaluation environment in a particular 
school district. Its validity was established during its development by 
conducting a content analysis of growth-producing teacher evaluation 
environF,er.ts and designing the TEP systematically to include key 
dimensions of these environments. Subsequent collection and analysis of 
questionnaire responses (see study three above) verified the predictive 
validity of those dimensions. Regression analyses using the TEP items to 
predict perceived overall quality and impact for user J^^ricts 
consistently produce .rultiple correlations in excess of .80. In additon, 
a factor analysis of the 44-item intercor relation matrix revealed five 
factors very similiar in composition to those designed into the 
instrument (Stiggins & Duke. 1988). suggesting an appropriate degree of 
construct validity. 

RELIABILir/ . Reliable instruments are those capable of P^o^^^^jng 
dependable or consistent data of variable interest. Dependability of TEP 
results was established by demonstrating that the combined set of 44 
items provides an internally consistent portrait of a teacher evaluation 
environment. The internal consistency reliability of the instrument as a 
whole is .93. internal consistency reliability estimates of each of the 
five subscales are reported below, along with subscale intercorrelations . 

Internal Consistency Reliability and 
Intercorrelations Among Original Five Scales 

(1) (2) (3) (4) (5) 



Attributes of teacher •"'2 



Attributes of evaluator 



.22 .94 



Attributes of evaluation feedback .17 .58 .77 



Attributes of feedback 
Attributes of context 



.16 .70 .76 .89 
.18 .W .58 .60 .71 
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SENSITIVITY. Appropriately sensitive instruments are those capable of 
producing results with sufficient precision to allow users to make 
desired dif f erentiaticr. on the bases of scores or attributes of 
interest. The TEP was designed to be powerful enough to detect the 
unique dimensions of the teacher evaluation environment oT each 
individual district. To test the power of the TEP microscope, it was 
administered to five pilot test districts and the results were analyzed 
to determine if the instrument could detect differences in the profiles 
of those districts. Results of a multivariate analysis of variance of 
the five subscale scores across the five districts, as reported below, 
reveals a sufficiently sensitive instrument. Each user district receives 
r<isults that are uniquely reflective of their own teacher evaluation 
environment • 

Results of One-way Multivariate Analysis of Variance 
Comparing Scale Scores Across Districts 



df 



Multivariate (Hotel lings ) 



8.44 



24,814 



.000 



Univar icJte : 

Teacher attributes 

Evaluate r attributes 

Procedures 

Feedback 

Context 



2.96 
7.68 
13.19 
7.10 
4.51 



4,460 



.020 
.000 
.000 
• 000 
.001 



COMMUNICATION VALUE . Useful instruments are those'that provide results 
in a form that can be understood and used by those who are in fact the 
intended users. Such instruments are said to have appropriately high 
communication value. The TEP relies on individual items and subscale 
data reflecting common sense and easily understood attributes and 
dimensions of the teacher evaluation environment. Since these 
characteristics are described in TEP reports in the form of simple 
summary statistics an'* graphic representations that translate into clear 
recommendations for action that can be understood and used by school 
personnel, it is clear that the TEP has high coiwnunication value. 

ECONOMY CP USE > Assessment instruments are said to be economical to use 
to the extent that high-quality, useful results are produced with an 
appropriate investment of time and effort by the user. The standard for 
what is considered an appropriate investment of time will vary across 
u«ers of the TEP. But users should realise that the thoughtful teacher 
will take between 15 and 20 minutes to complete the questionnaire. All 
results and summaries are generated automatically, requiring no further 
investment of time by the user. Thus, we regard this as a very efficient 
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and econoniical way to generate 
information-packed pictures of 
envirorj^ents that surround the 



very high-resolution and 

the relatively complex interpersonal 

teacher evaluation process. 



DIRECTIONS FCR ADMINISTRATION OF THE TEP 

To administer the TEP, the user needs to provide each teacher in the 
study with a copy of the TEP questionnaire, an NCS 16432 response form 
and a pencil. Questionnaires and NCS forms are available from KWREL. 

It is recommended that the questionnaire be completed at a time when the 
teacher can clear at least 20 minutes for quiet reflection. For ease and 
quality of administration, the following guidelines are suggested: 

• designate one person for the district and one person in each 

building to be responsible for the distribution and collection 
of forms; 

• designate one time when all teachers in a building will be given 
tiTT^e to coinplete the form, such as at a staff meeting; 

• collect the response sheets from the teachers, as these will 
need to be returned for analysis; and, 

• allow three weeks for return of the results. 



TEP 'REPORTS AND ANALYSES 

The reports and analyses generated from TEP responses allow each district 
to examine its teacher evaluation environment from a variety of 
perspectives. Each perspective contributes ultimately to the 
identification of a limited set of profile elements which hold wichin 
them the promise of maximizing the unique growth-producing potential 
within each user district. In short, each district can use the TEP 
reports to reduce the 44 items that comprise the total instrument to a 
set of 8 or 10 that are most important for that district. If these few 
items become the focal point of district action, they hold the promise of 
increasing the quality and impact of teacher evaluation in that district. 

OVERVIEW OF THE DATA SUMMARY . A total of four reports serve to summarite 
results for the user. These include: 

• a summary of the item-by-item distribution of responses across 
the rating associated with each item-*this reports data 
simultaneously for the user district and the total NWREL TEP 
population responding to date; 
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a o^a p>-ic profile of the teacher evaluation environment in the 
district-graphs plot district average responses to all items 
alcng with populaticr. averages and the highest and lowest 
district averages to date; 

, correlational analyses detailing which items are most strongly 
associated with perceived impact and quality for the 
district-summary identifies items with highest correlations to 
quality and impact ratings; and, 

• a n..rrative report interpreting results from the above reports 
and recommending action. 

The interpretive strategy used in preparing the narrative report is 
tSis: Ihe distributional report allows the user to i'*"^;^^ ^^'^ J^'" 
the responses of their teachers appear to spread across the range of 
J^ponse options differently than the larger population. The graphic 
profile allows the district to identify items where the average teacher 
Ta? ng is relatively high and low in comparison with other items in their 
ToUle. The correlational analysis allows the district to identify 
those iters that have a strong association with perceived impact and 
qua!!ty such that as the rating goes up impact and quality ratings tend 
to Qo up also. The goal of the TEP interpretation process is to identify 
those Uers that are relatively low in the profile and at the same time 
pred!cUve of impact and quality. If district actions focus on raising 
Jhlse elative lows, the profile will be improved «.d the P°«»^^l^^'/ 
will be high that perceived impact and quality will improve 
-interpretive process is illustrated below in the form of reports for a 
hypothetical Central School District. 

DISTRIBUTIONOFRESPONSES. In the pages that follow, we report the 

d I buTion of responses , item by item, for the Central School District 

facu ty of 46 teachers. Hote that the percent of the teachers select ng 

each response option is reported for Central on the top line of each item 

and for ?he population of several thousand teachers in 1 ne two of each 

scale! Scan these within each section (A. Attributes of you as a 

teach;r. B. Attributes of the evaluator, etc.) to find items where the 

district and population distributions within each item seem """t 

d fferent. sLply scan the data visually for trends. ^^'^ 

Uem! where the t^o distributions seem to differ the most. Note these 

and compare them to our list at the end of the report. 
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THE TEACHER EVALUATION PROFILE: 



A Questionnaire Reviewing Your Most 
Recent Teacher Evaluation Experience 



SUMMARY OF DISTRICT RESULTS 



Results for. Central School District 
Number of respondents: 46 



Top hne is Central School District. 

Bottom line is all teachers in all districts to date. 

A. Describe these attributes of you as a teacher: 



Percent 



ERIC 



5 
6. 



Profcssionul expectations 
of \ourself 

Oncniaiion to risk taking 

Orientation to change 

Orientation to experimentation 
in classroom 

Openness to criticism 

Knowledge of technical 
aspects of teaching 

Knowledge of subject matter 



I demand 


0 


0 


2 


39 


59 


1 demand a 


little 


0 


1 


6 


35 


58 


great deal 


I avoid 


2 


7 


28 


50 


13 


I take 


risks 


1 


8 


32 


40 


19 


risks 


I'm relatively 


0 


7 


24 


41 


28 


I'm relatively 


slov^ to change 


1 


4 


21 


39 


35 


flexible 


I don't 


0 


0 


22 


50 


28 


I experiment 


experiment 


0 


4 


26 


46 


25 


frequently 


I'm relatively 


4 


2 


28 


43 


22 


I'm relatively 


closed 


1 


8 


30 


41 


20 


open 


I know 


0 


4 


20 


57 


20 


I know a 


a little 


0 


2 


17 


47 


34 


great deal 


I know 


0 


2 


20 


50 


28 


I know a 


a little 


0 


0 


7 


40 


52 


great deal 



8 Years of teaching experience 



0 to 1 year 
2 to 5 years 
6 to 10 years 
11 to 15 years 
16 or more years 



This District 
Percent 

2 
33 
33 
22 

11 



All Teachers 
Percent 

3 
12 
19 
22 
43 



12 



2V 



Central School District 



Page 2 



Top line is Central School District. 

Br:'<-''>: line /5 all teachers in all districts to date 



Percent 
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9. Experience with teacher 
CNaluaiion pnor to most 
recent experience 



Waste of time 



17 17 41 15 9 Very 
10 23 36 22 9 helpful 



B. Describe >our perceptions of the person v^ho evaluated your performance (most recently): 

Percent 



10 



11 



Crcdibiljtv as a source 
of feedback 



Working relationship NMih you 

12 LcNcl of trust 

13 Interpersonal manner 

14. Tempera^nent 

15. Flexibility 



16 Knowledge of technical 
aspects of teaching 

;7. Capacity to demonstrate or 
model needed improvements 

18. Familiarity with your 
particular classroom 

19. Experience with 
classrooms in general 

20. Usefulness of suggestions 
for improvements 

21. Persuasiveness of 
rationale for suggestions 





1 


2 


3 


4 


5 


Not 


4 


24 


30 


17 


24 


credible 


6 


11 


25 


30 


28 


Adversary 


2 


9 


24 


22 


43 


3 


7 


21 


30 


39 


Not 


4 


20 


15 


24 


37 


trustworthy 


5 


8 


19 


28 


41 


Threatening 


2 


13 


15 


30 


39 


4 


7 


18 


2£ 


43 


Imoatient 


2 


15 


9 


43 


30 


3 


8 


21 


32 


36 


Rigid 


7 


13 


28 


35 


17 


6 


13 


26 


30 


25 


Not 


0 


17 


28 


30 


24 


knowledgeable 


3 


9 


21 


36 


31 


Low 


15 


22 


24 


30 


9 




11 


15 


30 


29 


14 


Unfamiliar 


15 


20 


13 


35 


17 




9 


18 


28 


28 


17 


Little 


11 


13 


11 


39 


26 




4 


11 


28 


33 


24 


Useless 


4 


24 


29 


22 


20 




6 


15 


30 


31 


18 


Not 


0 


30 


25 


30 


16 


persuasive 


7 


13 


34 


32 


14 



Very 
credible 

Helper 

Trustworthy 

Not 

threatening 
Patient 

Flexible 

Knowledgeable 

High 

Very familiar 
A great deal 
Useful 



Very 

persuasive 



13 



27 i 



Central School District 



Pace 3 



C. 



Top line IS Central Sehool Distriet. 

Bottom hm n all teaehers in all distriets to date. 

Describe these attributes of the procedures used during your most recent evaluation: 
What procedures Mere used to address the dimensions of your teaching (standards) to be 
evaluated? 

Percent 



22. 
23 
24 



Were standards communicated 

to >ou'^ 

Were standards clear 
to \ou'' 

Were standards endorsed by you as 
appropriate for your classroom'^ 

Were the standard-^ 







i. 




A 
*f 






Not 


22 


24 


15 


33 


7 


In great 


at all 


10 


13 


28 


33 


16 


detail 


Vague 


20 


24 


15 


20 


22 


Clear 


8 


13 


23 


30 


26 




as Not 


16 


27 


20 


24 


13 


Endorsed 


endorsed 


9 


10 


26 


30 


25 




The same for 


23 


7 


2S 


19 


23 


Unique 


all teachers'' 


24 


12 


32 


18 


15 


to you? 



To Mhat extent \%ere the following sources of performance Information tapped as part of the 

evaluation? _ 

Percent 



26 Observation of your 
classroom performance 



Not 
considered 



27. Examination of classroom or school Not 
records (lesson plans, etc.) considered 



28. Examination of 

student achievement 



Not 
considered 



18 13 18 22 29 

3 7 20 31 39 

31 11 18 29 11 

22 19 29 22 8 

28 17 26 20 9 

25 20 31 17 7 



Used 

extensively 
Used 

extensively 
Used 

extensively 
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Extent of observation In your classroom, based on your most recent experience: 

(Note: In these Items, FORMAL refers to observations that ystxtV^x^^^'^ixA and 
were preceded and followed by a conference with the evaluator, INFORMAL refers to 
unannounced drop-In visits) 



29. Number of FORMAL (prescheduled) 
observations per year 



14 



0 

1 

2 
3 

4 or more 

272 



This District 

Percent 

33 
46 
13 

2 

7 



All Teachers 

Percent 

14 
35 
39 

8 

5 



Central School District P^ge 4 

This District All Teachers 

30 Approximate frequency of Percent Percent 

INFORMAL (unannounced drop-in) — — 

observations None 29 22 

Less than 1 per month 13 46 

Once per month 33 22 

Once per week 22 9 

Daily 2 1 



Top line is Central School District. 

Bottom line is all teachers in all districts to date. 

Please describe these attributes of the feedback you received: 

Percent 



31 Amount of information 
recei\ ed 



None 



32 Frequency of fcmal feedback Infrequent 

33 Frequenc\ of informal feedback Infrequent 
34. Depth of information provided Shallow 



35 Quality of the ideas and suggestions Low 
contained in the feedback 



36. Specificity of information 
provided 



General 

37. Nature of information provided Judgmental 

3a Timing of the feedback Delayed 

39. Feedback focused on district Ignc 
teaching standards tl 



1 


2 


3 


4 


5 






4 


22 


38 


27 


9 


Great deal 


5 


17 


35 


30 


14 




33 


40 


16 


4 


7 


Frequent 


21 


23 


32 


16 


8 




14 


34 


14 


27 


11 


Frequent 


21 


22 


29 


19 


9 




16 


27 


31 


16 


11 


Indepth 


12 


19 


34 


26 


9 




16 


20 


22 


27 


16 


High 


11 


16 


32 


28 


13 




14 


25 


25 


25 


11 


Specific 


11 


16 


29 


28 


15 




9 


13 


18 


44 


16 


Descriptive 


6 


10 


30 


33 


21 




11 


16 


25 


23 


25 


Immediate 


9 


9 


21 


33 


27 




1 19 


24 


31 


14 


12 


Reflected 


I 5 


10 


32 


29 


23 


them 
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Central School District 



Pdcc 5 



Top line is Centra! School District. 

Bo:ioni line is all teachers in all districts to date 

E Describe these attributes of the e\aluation context: 

Percent 



1 2 3 4 5 



40 Amount of time spent on the None 4 36 36 22 2 Great deal 
evaluation process including your 4 25 42 23 / 

time and that of all other participants 

Resources a\ai!able for professional development: 

41 Time allotted during the teaching 
da\ for professional development 



-4^ 



A\a:labilii\ of training programs 
and models of good practice 



District \alues and policies in e\aluation: 

4? ClariT\ of policy statements 

regarding purpose for evaluation 

44 Intended role Teacher 27 16 20 16 22 Teacher 

ofexaluat.on accoun.abihty 19 15 30 2C 16 growth 



None 


24 


47 


16 


9 


4 


Great deal 




35 


32 


21 


9 


3 




None 


18 


27 


27 


22 


7 


Many 




14 


29 


30 


17 


10 




Vague 


18 


20 


27 


24 


11 


Clear 


12 


18 


32 


23 


16 





RATING THE QUALITY AND IMPACT OF THE EVALUATION 

Percent 

Very Low 0123456789 Very High 



As vou think about this experience, how 9 6 6 ^ 11 23 6 11 14 6 
would vou rate the Ox erall Quality 3 4 5 6 7 16 11 21 17 10 



of the evaluation? 



Rate the Overall Impact of your last 12 9 21 9 15 12 3 6 12 3 



evaluation experience on your 
professional practices. 



11 10 1/ 10 8 16 9 12 8 3 



Prepared by: 

Center for Performance Assessment 
Northwest Regional Educational Laboratory 
101 S. W. Main St^ Suite 500 
Portland, Oregon 97204 
(503; 275-9500 



ERIC 



16 
^ i 4 



The following item distributions are worthy of note: 

A. Attributes of the Teacher 

Iten- 6. Knowledge of the technical aspects of teaching 
(district a i^it low at extreme high end) 

Item 7. Knowledge of subjec. matter (district relatively low) 

Item 8. Years of teaching experience (district somewhat less 
experienced} 

B. Attributes of the Evaluator 

Item 10. Credibility as a source of feedback (district somewhat 
lower ) 

C. Attributes of the Procedures 

The district seems somewhat lower on these items: 

Ite" 22. Comr.unicaticr. of standards 

Iter 23. Clarity of standards 

Item 24. Standards endors^rd as appropriate 

Item 26. Observation of classroom performance 

Item 29. Number of formal observations 

D. Attributes of the Feedback 

Item 32, Frequency of formal feedback (less frequent in 
district) 

Item 39. Feedback focused on district standards (district low) 

E. Attributes of the .ontext 

Item 40* Amount of time spent on evaluation (district a bit low) 

Ite-^ 44. Intended role of evaluation (district a bit wore 
accountability oriented) 

GRAPHIC PROFILE . The graphic profile of district results reports average 
rasponsec to items for teachers in tha usar district. This pictorial 
representation of the results allows tha user to identify those items 
that «re aOw relative to all oth-*r items in their om p-ofile and those 
of other districts. 
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The graphs for Central School District averages follow. Note that the 
total population averages and the extremes of prior user district 
averages are reported also. These are provided as reference points for 
co*pt?!son Sc'n the graph, to find the items that .eem .omewhat low 
co^p^id Jo other district averages and compared to population averages. 
Note these and compare them to our list provided at the °f f * 
graphs. Incidentally, you will note on the first graph that the district 
average rating of perceived impact and quality are lower than the 
population average rating. 
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NWREL T.E.P. - Graphs of District Results 

Pre-Survey Items, Average Ratings 



T Highest District to Date 
J_ Lowest District to Date 
■ All Teachers to Date 
T This District 



4.8^' 



Attributes of Teacher 

Average Ratings 



i 



4"I 1 

3.8 ▼ 



3.9 



4.0 



3.1 



T Highest District to Date 

i. Lowest District to Date 

■ All Teachers to Date 

T ▼ This District 



2.8 



T" 

EXPECTA- 
TION 
1 



MENT 



T 



—I 1 1 ' 

RISK CHANGE EXPERI- CRITICISM KNOW KNOW 

TEAM SUB 
5 6 7 

Item Numl)er 



YRS 
F.XP 
8 



— r 

FVAL 
EXP 
9 



5-1 



4 - 



K> 



01 

C 
c 

S 



2 - 



Attributes of Evaluator 

Average Ratings 



4.0 



3.3 



3.7 



I 

3.9 ^' 



3-9 



3.4 



" 1 



3.6 



3.2 



3.0 



3.3 



3.3 



I 



—I 1 1 1 T" 

CRED RELATION TRUST MANNER TEMP 



10 



n 



12 



13 



14 



1 1 r r- 

FI.EX KNOW DEMO/ FAM 
TEACH MOD CLRM 
15 16 17 18 

Item Number 



T 



T 



EXP USEFUL PERSIIA- 
CLRM sue. SI VI. 
l<) ?<) ?\ 



2Si 



Attributes of Procedure 

Average Ratings 



1 



4 - 



to 



c 



S 3 



2 - 



3^ 



2.8 ± 



2J 



3.1 Y 



3.3 



2.8 



2.6 



2.6 



2.0 



T ^^ighest District to Date 

J. Lowest District to Date 

■ All Teachers to Date 

▼ This District 



"T" 

COHH 
STD 
22 
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-| 1 1 r 1 r 

CLEAR APPROP UNIQUE OBSFRV RECORDS ST. 
STD STD STD 

23 24 25 26 27 2B 

Item Numbe; 



— I 1 

FORMAL INFORMAL 
OH OB 
?9 30 



Attributes of Feedback 

Average Ratings 



T Highest District to Date 

X Lowest District to Date 

■ All Teachers to Date 

▼ This District 



3.4 w 



3.3 



3.1 



3. ▼ 



2J 



3.0 



2.8 4. 



2.1 



-1 1 1 \ « ^ ^ ' ^ 

AKT FORMAL INFORMAL INFO QUALITY SPECIFIC NATURE TTMINC DIST 
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Attributes of Context 

Average Ratings 
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1 

MODELS 
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42 



2.9 



2.9 



1 

CLARITY 

43 



I 

EV ROLE 



Item Number 



T Highest DIstric* to Date 

J. Lowest District to Dale 

■ All Teachers to Date 

▼ This District 
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Based cr. these graphs, the following items are worthy of discussion: 
PRE-SURVEi ITEMS 
Qualit} : 



Impact: 



A. 



District teachers rated quality considerably lower than 
other teachers. 



Kated relatively low in district and in relation to other 
districts. 



Attribute? of Teacher 
Item 6. 



Knowledge of technical aspects of teaching (low 
relative to other districts) 



Item 7. Knowledge of subject matter (a new low district 
average) 

Iteir. 8. Years of teaching experience (relatively inexperienced) 

Item 9. Previous evaluation experience (very 
accountability-oriented) 

B. Attributes of Evaluator 

In this set, tvo-thirds of the district average responses are 
below tr.e large sample average. In particular, note these: 

Item 10. Average credibility of the evaluator (relatively low 
in district and in relation to other districts) 

Iterr 17. Capacity to demonstrate or model needed improvements 
(relatively low in district and in relation to other 
districts) 

Item 18. Familiarity with my classroom (relatively low in 
district and in relation to other districts) 

C. Attributes of Procedures 

Responses that are rated considerably lower than all teachers to 
date and are relatively low in this district's ^rofil* are: 

Item 22. Communication of standards 

Item 23. Clarity of standards 

Item 24. Endorsement of standards as appropriate 

Item 26. Observation of classioom performance 

Item 29. Frequency of formal observations 
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D. Attribit.*'fi cf Feedback 

Ir this set of responses, note that the following items seem 
both low in the profile .nd below the large .an.ple average: 

Ite" 32. Frequency of formal feedback 
Item 34. Depth of information 

Item 39. Feedback focused on district standards 

E. Attribute s of Context 

in this case, those that are relatively low in the district's 
profile are still above average in relation to the larger 
sample. Those below the large group average are: 

Item 40. Amount of time spent on evaluation 

Ite- 44. Intended role of evaluation 

• cross .i: «.ch..s i. th. i.str.ct. « 'J"' '"^^f {[^l „p „ 

oualitv high, which items are likely to be rated "19"- 
and quality moves up and down. 

•n,. ..cond kind of cort.l.tion.l d.t. r.port.d i. . r.,r...iv. .«.lysi.. 
rating most precisely, which would th«y b«? 

in fact, the combination of the correlations «d -^-"1^ /.ttirilrough 
gives the district the best sense of those 7"^; [ ^ associated 

revisions in the teacher evaluation proces.. would tend ^ f JJ'"^*" 
wHh improved impact and quality. Scan the two report, that follow. 
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listing these iterrs that stand out in terms of high correlations. Then 
compare your list with the list that fallows the reports. 
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NWREL TEACHER EVALUATION ??.OFILE QUESTIONNAIRE 



First-Order Correlations of items 
and Scales with Overall Rating 

Central School District 



Correlations 


: Overall 




Teacher 




Feedback 


ITLnl 


• H\J\JD 


ITEM31 


1 ILnc 


• xH 1 V 


ITEM32 


1 ILK J 


7 ^7 ft 


ITEM33 




1 ^2 

• X ^ 


ITEM34 




• 1360 


ITEM3 5 


TTEMf 


. 1783 


ITEM36 


T Trui 
1 iLn / 


» X ^ J X 


ITEM37 


T TFUft 

1 iLno 


" • A J «/ w 


ITEM38 




• A w w 


ITEM39 


Evaluator 




Context 


ITEMIO 


.4781 


1 rEM40 


ITEMll 


. 5530 


ITEM41 


ITEN12 


.4358 


ITEM42 


ITEMl 3 


.4188 


ITEM4 3 


ITEM14 


. 5204 


ITEM44 


TTEMl 5 


. 3321 




ITEMl 6 


.1770 




TTEMl 7 


. 3476 


TEACHER 


TTEMl 8 


.4022 


EVAL 


TTEMl 0 


.0167 


INFO 


TTFM2n 
X X brib w 


.47 87 


FEEDBACK 


TTrM5 1 


.4 831 


CONTEXT 


Performance 


Data 




ITEM22 


.6167 




ITEM23 


. 5937 




ITEM24 


.6417 




ITEM25 


.0325 




ITEM26 


.4185 




ITEM27 


,4565 




ITSM28 


.5144 




ITEM29 


.4309 




ITEM30 


.0324 





.6350 
.4805 
.1942 
.4599 

.3300 
. 5320 
.5078 
.6191 
.5204 



.4781 
.4317 
.5839 
.5146 
.5965 



.4860 
.4866 
• 6815 
.6279 
.7163 
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NWREL TEACHER EVALUATION PROFILE QUESTIONNAIRE 
Multiple Regression of Items on Overall Rating 
Central School District 



Summary Table 



Step MultR 
.6417 

.7801 
.8303 
. 8762 
.9067 
. 9353 
.9574 
. 9839 



Rsq 
.4118 
.6085 
.6893 
. 7677 
.8221 
.8749 
.9166 
.9682 



F(Eqn) 
21.702 
23.315 
21.450 
23.133 
24.947 
30.292 
39.255 
91.200 



.000 
.000 
.000 
.000 
.000 
.000 
.000 
.000 



Variable 

In: ITEM24 

In: ITCM38 

In: ITEM44 

In: ITEM34 

In: ITEM31 

In: ITEM7 

In: ITI:m16 

In: ITEMS 



Betain 
.6417 
.4660 
.3260 
-.4870 
.3349 
.2448 
-.2682 
-.2518 
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The data suggest that the following items have the highest correlation: 

A. Attributes of the Teacher 

Iten^ 9. Previous evaluation experience 

B. Attributes of the Evaluator 

Item 10. Credibility as a source of feedback 

Item 11. Working relationship with the teacher 

Item 14. Temperament of the evaluator 

Iter* 20. Usefulness of suggestions provided 

Item 21. Persuasiveness of rationale for suggestions 

C. Attributes of the Procedures 

Item 22. Corninuni cation of standards 
Item 23. Clarity of standards 

Item 24. Endorsement of standards as appropriate 

D. Attributes of the Feedback 

Item 31. Amount of information received 

Item 36. Specificity of feedback 

Item 37. Nature of feedback provided 

Item 38. Timing of feedback provided 

Item 39. Feedback focused on district standards 

E. Attributes of the Conwext 

Item 42. Availability of training programs and models of good 
practice 

Item 43. Clarity of policy statements 

Item 44. Intended role of evaluation 

These r;or relational results are combined with those results reported in 
previous sections to provide a summary and a set of recommendations to 
the user district* 
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irofi rand in relation to the large sample averages are Ixsted xn column 
B The tten,s that are predictive of high impact ai>d qualxty are depxcted 
!; cl?u.n C Then those items that «.em som.what low for the d.str.ct 
(i.e.. appear ii> columi> A or B) ai>d at the same time have high 
correlations with impact and quality (i.e., appear in column c) are 
se ic;ed out. Those appear in column D. If the district tak.s «tion to 
raite the Ratings of these attributes of the evaluation environn^ent, the 
cJ«ce are great that perceived impact and quality will go up also. 



Lower than 
large population 

A 6 
7 
8 

P 10 



B 

Relatively low 
within profile 

A 6 
7 
8 

B 10 
17 
18 



Predictive of 
impact and quality 

A 9 



10 
11 
14 
20 
21 



Items appearing 
in A or B and C 

10 
22 
23 
24 
39 
44 



22 
23 
24 
26 
29 

32 
39 



22 
23 
24 
26 



32 
34 

39 



22 
23 
24 
28 



31 
36 
37 
38 
39 



S 40 

44 



E 40 
44 



42 
43 
44 



For central School District, the table tells us that the following items 
might be profitable targets for such action: 

Item 10. Credibility of the evaluator as a source of '••^^ack 
Item 22. Communication of performance standard, or criteria to 
teachers 
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Iteir. 23. Clarity of performance standards to teachers 

Itei^ 24. Endorsement of standards by teachers as appropriate 

for their context 
Iteir, 39'. Focus of feedback on district performance standards 
Iteir 44. Intended role of evaluation (from accountability to 

growth) 

If Central can act to raise the credibility of supervisors as valuable 
sources of good .deas for more effective teaching, address a variety of 
issues about the clarity and communication of performance expectations 
and create a context where the evaluation process is perceived as serving 
teacher growth purposes, the perceived quality and impact of evaluation 
(which were rated low by the teacher, you may recall) may well go up. 



THE W ARRATIVE REPORT . The TEP is a powerful enough microscope to detect 
subtle and not so subtle differences in the teacher evaluation 
environments as they vary from district to di'^rict. Strengths and 
weaknesses reflected in the profiles can and do vary greatly. The items 
most .-.ighly correlated with impact and quality also vary significantly 
across districts. Thus, the combinations of items selected for possible 
action ir. each district are uniquely important for that district. 

For this reason, the final report included in the TEP service P^J^ge is 
a written narrative report that takes the district through each of the 
Ltl Ina^ysis and interpretation process described above. Relatively low 
items are identified, as are predictive items, and these are combined 
into a set of recommendations unique to that district. 

in addition, the narrative report recommends some of '^'^^ 
districts might take to deal with their key elements. That is, NWREL 
dols not assL that the user will automatically know how to act upon TEP 
results, we recommend specific procedures that might help raise those 
low ratings districts may wish to address. 



SUMMARY AKT CONCLUSION 

The TEP was developed out of an extended program of rteearch that 
identified those attributes of a teacher evaluation environment that made 
the evaluation experience growth producing for the teacher, .t was 
designed to help district, identify thc-.e attribute, that repre.ent the 
.trengths and weakne..e. of their unique evaluation environment, «o they 
could diagnose tneir own needs with respect to creating a , . , ^„ 

groith-pJoducing environment. It was also designed to allow dirtric . to 
track the evolution of their evaluation environment over time .s their 
growth orientation changes. 

For a minimal investment of a few moments per teacher, the user 

profile 44 specific attributes of their evaluation environment, including 

the teacher as a contributor to the evaluation, the evaluator, the 
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•valuation procedures used, the feedback provided, and the context within 
which the evaluation takes place. Given the multifaceted portrait of 
their unique teacher evaluation environment, provided by the TEP, a 
district evaluation study coiwnittee consisting of teachers, supervisors 
and district-level administrators can take concrete and specific action 
in the direction ol helping teachers to become more competent and 
confident professionals. 
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INSTRUCTIONS 



This forrr. has beer designed to allo\N you to describe your experience with 
teacher e\2lua!ion in some detail. Your responses will be combined NMth those of 
other teachers to vield a picture of the key ingredients in an effective teacher 
evaluation experience. The goal of this research is to determine how the evaluation 
process can be revised to help it serve relevant and useful purposes. If we are to 
reach this goal, it will be important for you to provide frank and honest responses. 
This IS vkh\ your ansvNcrs will remain anonymous. 

As vou will see. this is not a superficial questionnaire. It is designed to be 
compre}ien5i\e in scope and will take more than a few minutes to complete. For 
this reason, it iS crucial that vnn read and folloNN these instructions verv carrfullv- 
Please se: aside 15 uninterrupted minutes to provide thoughtful responses. 

THT nFFi\'iT Tn\ OF tfacher evaluation 

Gu:d:;;r.es for teacher evaluation often specify that probationary teachers be 
evaluated annualN v^hile tenured teachers must be evaluated bienniallv or some 
other regular cvcle Th: process leading to the annual evaluation usually consists of 
a goal scning plan, classroom observation, and confei ;ncing betwcf n teacher and 
supervisor before and after the observation When reference is n.ade in this 
questionnaire to ^eachcr evaluation , it should be understood to encompass all these 
elements 



IMPORTANT READ BEFORF FI1 1 TNG O rT TEACHER EVALUATION 
PROFJLE 

<;PFriFTr t\^tri]CTIONS-rating column a OUAUTY OF 

E VALUATION AND COLUMN B IMPAC T OF EVALUATION 

rm \ IMN a . <;PFrT AT rnnF«s - rating oiiat ttv of fvaluatiqn 

Given this definition of teacher evaluation, please reflect on the last time you 
were evaluated; that is, your most recent experience with your teacher evaluation 
system. Regard the entire evaluation process, including planning for evaluation, 
classroom obssrvations and feedback. As you think about this experience, how 
would you rate the overall quality of the evaluation? Use • scale from 0 to 9, with 0 
representing very poor quality and 9 very high quality. 

Novk plrase enter your response on the NCS response form 16432 which you have 
been given by following these instructions: 

o Find the side of the form thai is printed in brown. 

o Then find the IDENTIFICATION NUMBER BOX in the upp^r left corner and 
the SPECIAL CODES box to the right of that. Under SPECIAL CODES, find 

Column A. 
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Using a ' 2 pencil, please write your Rating of Overall Quality in Column A of 
the SPECI AL CODES box Then blacken the corresponding circle for that 
rating in Column A bclou. 
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COLUMN B - SPECIAL CODES - RATING IMPACT OF EVALUATION 

In the next column of the SPECIAL CODES box Column B, rate the Overall 
Impact of your last evaluation experience on your professional practices. A high 
rating of 9 would reflect a strong impact leading to profound changes in your 
teaching practices , attitudes about teaching and/or understandinf of the teaching 
process A low rating of 0 would reflect no impact at all and no changes in your 
practices, attitudes and'or understanding. 

Leaxc the remaining lines in the ID, DATE and SPECIAL CODES boxes blank 

GENERAL INSTRU-CTIONS- RATING ATTRTRTJTES OF EVALUATION 

Now. please use the scales provided on the following pages to describe yourself 
and the nature of your most recent teacher evaluation experience. Do this by: 

o Considering each of the 44 attributes to be described, 

o Studying the scale to be used to describe each 

o Selecting the letter that represents the point you select on each scale, and 
o Coding that letter on the NCS form. 

BE SURE THE NUMBER OF THE ATTRIBUTE YOU ARE DESCRIBING 
CORRESPONDS TO THE NUMBER ON THE RESPONSE SHEET WHERE 
YOU ENTER YOUR RESPONSE 
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1. Rate .the strength of your 
professional expectations 
of yourself 

2 Orientation to risk taking 

Orientation to change 



3 
4 
5 

6. 
7 
& 



Orientation to experimrrtation 
in Classroom 



Openness to criticism 

dedcc 
ts 01 

Knowledge of subject matter 
Years of teaching experience 



Kncwledce of technical 
aspects 01 teaching 



1 £!f mand 




I demand 


little 


1 2 34 5 


great deal 


I avoid 




I take 


risks 


1 2345 


risks 


1*m relativelv 




Vm relatively 


slow to change 


1 2345 


flexible 


I don*t 




I experiment 


experiment 


1 2345 


frequently 


rm reittively 


1 2345 


rm relatively 


closed 


open 


I know 




I know a 


a little 


1:345 


great deal 


I know 




I know a 


a little 


1 2345 


great deal 


I 


0 to 1 year 




1 


2 to 5 years 


3: 


6 to 10 years 


4: 


11 to 15 years 


5: 


16 or more years 



Experience with teacher 
evaluation prior to most 
recent experience 



Very 
1 2 3 4 S helpful 



B. Pf <rrihe voyr perceptions 
(mno recently'): 



Waste of time 
nf ihf person u'hr> evalu>tfH voiir performance 



10 


Credibility ss a source 
of feedback 


Not 
credible 


1 2 345 


Very 
creoible 


11 


Working relationship with you 


Adversary 


12345 


Helper 


12 


Level of trust 


Not 

trustworthy 


12345 


Trustworthy 


13 


Interpersonal manner 


Threatening 


12345 


Not 

Threatening 


14. 


Temperament 


Impatient 


12 345 


Patient 


15. 


Flexibility 


Rigid 


12345 


Flexible 


16. 


Knowledfe of technical 
aspects 01 teaching 


I ot 

knowledgeable 


12345 


Knowledgeable 


17. 


Capacity to demonstrate or 
model needed improveoettts 


Uw 


12345 


High 


1& 


Familiarity with your 
particular clasiroom 


Unfamiliar 


12345 


Very familiar 


19. 


Experience with 
classrooms in general 


L' .le 


1234 5 


A great deal 
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20 Usefulness of suggestions 
for improNements 

21 PersuasiNeness of 

rationale fo: suggestions 



Useless 

Not 
persuasive 



1 2 3 4 5 
1 2 3 4 5 



Useful 
Very 

persuasive 



C. Dfscnhe the^p attributes nf the procedures usgd during vour most recent 
evaluation' 

1 What procedures ^ere used to address the dimensions of your teaching (standards) to be 

evaluatid^ 



22 Were standards communicated 

to you'' 

2^ ^ ere standards clear 
to you'' 

24 Were standards endorsed b\ 
you as appropriate for 
you: classroom'' 

25 N^e:e the standards. 



Not In great 

at all 1 2 3 4 5 detail 



Vague 12 3 4 5 Clear 



Not 
endorsed 

The same for 
all teachers'^ 



1 2 3 4 5 Endorsed 

Uincue 
1 2 3 4 5 to you? 



To vkhat extent v^ere the follov^ing sources of performance information tapped as 

pa:: of the evaluation'' 



26 Observation of your 
classroom performance 

2" Examination of classroom 
or school records 
(lesson plans, etc ) 

'Jb Examination of 

student achievement 



Not 
considered 

Not 
considered 

Not 
considered 



Used 

1 2 3 4 5 extensively 
Used 

1 2 3 4 5 extensively 
Used 

1 2 3 4 5 extensively 



Extent of observation in your classroom, based on your most recent experience: 

(Note In these items. FORMAL refers to observations that were preannounced and 
were preceded and followed by a conference with the evaluator; INFORMAL refers 

to unannounced drop*in visits) 



29 Number of FORMAL (prescheduled) 
observations per year 



30. Approximait; frequency of 

INFORMAL (unannounced drop-in) 
observations 



1 0 
1 1 
3: 2 
4: 3 

5: 4 or more 



1: None 

1 Less than 1 month 
3: Once per month 
4: On*^ oer week 
5: 
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D pipage dfgcnhe thr^r att ributes of thf feedback vou received 



31 Amount of information 
rccciNcd 

32 frequency of formal feedback 

33 Frequency of informal feedback 

34 Depth of information provided 

35 QualitN of the ideas and 
suggestions contained in 
rbe feedback 

36 Specificity of information 
provided 

37 Nature of information provided 

3S Timing of the feedback 

39 Feedback focused on district 
tcjchinc standards 



None 
Infrequent 
Infrequent 
Shallow 



General 

Judgmental 

Delayed 

Ignored 
them 



1 234 5 
12345 
1 234 5 
1 2 34 5 



1 2 34 5 
1 234 5 

1 2 34 5 

1 2 34 5 



Great deal 
Frequent 
Frequent 
Indfpth 



Low 1 2 3 4 5 High 



Specific 

Descriptive 

Immediate 

Reflected 
them 



E pe^rnhe thf attnbuti ^^ of the evaluation context: 



40 Amount of time spent on the 

evaluation process including your 
time and that of all other 
participants 



None 12 3 4 5 Great deal 



Resources available for professional development. 



41 Time allotted during 
the teachinc da> for 
professional dcxelopment 

42 Availability of training 
programs and mooels of 
good practice 



None 1 2 3 4 5 Great deal 



None 1 2 3 4 5 Many 



District values and policies in evaluation: 



43. 



44. 



Clarity of policy 
statements regarding 
purpose for evaluation 

Intended role 
of evaluation 



Vague 

Teacher 
accountability 



1 2 3 4 5 Clear 

Teacher 
12 3 4 5 growth 



Thank you for your thoughtful respoLrts. 
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